Insert Fixed Width data into SQL database.
I have a file sent from a client that I need to get into a SQL database.
The file name is ELIG and it is in a flat file, fixed width format.
I am just going round and round how to get the data into a database using SSMS.
Because another user is going to be doing this in the future it needs to be easy.
I tried tasks, import data, flat file, file path and then "Fixed Width", but it puts all of it in one field.
the data does NOT have headers either.
I'm not good at this kind of thing so would appreciate any help I can get.
Gee
Yes I saw Uri's request and I'd love to comply, since this is giving me such a hard time, but the data is too sensitive and I would be shunned by my employer and thrown out into the street.
I've been all over google trying to find a solution. I'm still a bit of a novice, but even so, I have never found data that is so hard to normalize. Just error after error.
Gee
Hi Gee,
I can understand your issue :-)
it is a common issue that people think that we can read minds, troubleshoot issues without having the option to test it and without any information regarding the issues. It is like going to the children doctor and ask him to treat your children without taking
the your children to the doctor. If you can not take the children to the doctor, then you might need to take a doctor to the your children!
Troubleshooting can be tedious, because there may be quite some information you will need to supply. If you can not post the information in public, then maybe you need to get a private supporting, but this will cost you (your boss/company).
Option 1: Create a case study which is based on your real issue. Use different DDL and DML (database structure and data) than the real database, and reproduce the issue in a way that you can post us the information that we need. We have
to get the ability to reproduce the issue in our server as well, if you need our support.
Option 2: Use the real database information with private support,
after the supporter sign a Confidentiality agreement. If you check people profiles in the forum, then you will find that most of the supporters here are actually work as consultants and they give support on a daily
bases. This is our job. In the forum we come to help volunteer, but
there is a reason why people continue to pay for support. free public support do not fit all :-)
Ronen Ariely
[Personal Site] [Blog] [Facebook]
Similar Messages
-
How to Create a Rich Dynamic Input and Output PDF to insert and get data into, from Database (MSSQL)
HI ,
I want to use Adobe LiveCycle Designer and Adobe LiveCycle Workbench features to create a Dynamic PDF form which can allow me to store data into database(MSSQL Server) and Can also provide me the Output PDF form with all the information which has been been filled in by the User in input form. Both Input and Output forms must be Dynamic. I am stuck in this process and Need Experts Advice on the Complete optimal process flow of the Adobe.
Regards
Ritesh GroverHI
Go to the lay out of your screen and doublr click on the table control fields, you can get the Properties/Attribute of the screen or table control Fields
Assing a Group GRP1 for all the fields i n the table control.
in PBO
if ok_code = 'INPUT'.
LOOP AT SCREEN.
IF screen-grp1 = 'GRP1'.
screen-input = 1.
modify screen.
endif.
ENDLOOP.
elseif ok_code = 'OUTPUT'.
LOOP AT SCREEN.
if screen-grp1 = 'GRP1'.
screen-input = 0.
modify screen.
endif.
endloop.
endif.
Regards
Ramchander Rao.K
Edited by: Ramchander Krishnamraju on Aug 8, 2009 5:27 AM -
Insert data into sql database where the values are in an array
Hello Experts,
using vbscript i want to store data in MS SQL. i have prepared a script which works fine when i provide the static value but in actual i get the values in an array and now want to store values from there.
Below is not complete code but the block in question.
oRecordset_Working.Open "INSERT INTO tbl_work (release, version, state, Arch)" & _
"VALUES ('5.2', '11.25' , 'Active', 'XYZ')", _
oConnection, adOpenStatic, adLockOptimistic
i verified the database and can see the information is feeded.
What i really want to make work is:
for i=0 to UBound (arrValues)
oRecordset_Working.Open "INSERT INTO tbl_work (release, version, state, Arch)" & _
"VALUES ('arrValues(i)')", _
oConnection, adOpenStatic, adLockOptimistic
Next
logically it is incorrect as INSERT query comes inside the loop but then how can someone make it work?
can someone help me with this?
-KAKA-Here is the preferred method of inserting multiple values into multiple fields. It is very fast and very easy to set up.
Const adBSTR = 8
Const adInput = 1
Const CONNECTION_STRING = "Provider=Microsoft.ACE.OLEDB.12.0;Data Source=c:\temp\test.mdb;Persist Security Info=False"
Const SQL_INSERT = "INSERT INTO Table1(ID, Name, Notes) VALUES(?, ?, ?)"
Set conn = CreateObject("ADODB.Connection")
conn.Open(CONNECTION_STRING)
Set cmd = CreateObject("ADODB.Command")
With cmd
.ActiveConnection = conn
.CommandText = SQL_INSERT
.Prepared = True
' create parameter object and assign to command object
.Parameters.Append .CreateParameter("ID", adBSTR, adInput)
.Parameters.Append .CreateParameter("Name", adBSTR, adInput)
.Parameters.Append .CreateParameter("Notes", adBSTR, adInput)
End With
' bind and insert values
For i = 2 To 10
cmd.Parameters("ID") = "ID" & i
cmd.Parameters("Name") = "Joe" & i
cmd.Parameters("Notes") = "My notes"
cmd.Execute
Next
conn.Close
¯\_(ツ)_/¯ -
How to insert wifi scan data into sql table
Urgent assist required. Can someone help pls, i have scanned wifi data in C# that i have split into required format MAC,SSID and RSSi . I want when i push a button the results are inserted into an sql table that i already created. and if i push the buton
again it stops inserting. I have tried several methods and could not get it to work, Will appreciate assist
using System;
using System.Collections.Generic;
using System.ComponentModel;
using System.Data;
using System.Drawing;
using System.Data.SqlClient;
using System.Linq;
using System.Text;
using System.Threading.Tasks;
using System.Windows.Forms;
using System.IO.Ports;
namespace WICED_SERIALPORT_TEST
public partial class Form1 : Form
public Form1()
InitializeComponent();
private void button1_Click(object sender, EventArgs e)
string[] ports = SerialPort.GetPortNames();
foreach (string port in ports)
comboBox1.Items.Add(port);
string t;
private void button2_Click(object sender, EventArgs e)
t = comboBox1.Text.ToString();
sErial(t);
SerialPort sp;
void sErial(string Port_name)
sp = new SerialPort(Port_name, 115200, Parity.None, 8, StopBits.One);
sp.DataReceived += new SerialDataReceivedEventHandler(DataReceivedHandler);
sp.Open();
private void DataReceivedHandler(object sender, SerialDataReceivedEventArgs e)
SerialPort sp = (SerialPort)sender;
string msg = string.Empty;
bool canCont = false;
while (!canCont)
msg += sp.ReadLine();
if (msg.Contains("Scan complete "))
canCont = true;
//string w = sp.ReadLine();
//string w = sp.ReadExisting();
// string msg = sp.ReadExisting();
string[] msgArr = msg.Split('\r');
Invoke(new Action(() => listBox1.Items.Clear()));
List<string[]> list = new List<string[]>();
List<Networks> Scan = new List<Networks>();
for (int i = 0; i < msgArr.Length; i++)
list.Add(msgArr[i].Split(new string[] { " " }, StringSplitOptions.RemoveEmptyEntries));
for (int i = 0; i < list.Count; i++)
if (i > 2)
if (list[i].Length > 4)
int numOfSplits = 0;
List<string> tempList = new List<string>();
for (int ii = 0; ii < list[i].Length; ii++)
if (numOfSplits < 6)
string[] temp1 = list[i][ii].Split(new char[] { ' ' }, StringSplitOptions.RemoveEmptyEntries);
numOfSplits += temp1.Length;
for (int iii = 0; iii < temp1.Length; iii++)
tempList.Add(temp1[iii]);
else
tempList.Add(list[i][ii]);
Scan.Add(new Networks()
ID = Convert.ToInt32(tempList[0]),
NetworkType = tempList[1],
MAC = tempList[2],
RSSi = Convert.ToInt32(tempList[3]),
Rate = Convert.ToDouble(tempList[4]),
Channel = Convert.ToInt32(tempList[5]),
Security = tempList[6],
SSID = tempList[7],
if (msg != String.Empty)
Invoke(new Action(() => richTextBox1.AppendText(msg)));
for (int i = 0; i < Scan.Count; i++)
Invoke(new Action(() => listBox1.Items.Add(Scan[i].MAC)));
Invoke(new Action(() => listBox2.Items.Add(Scan[i].RSSi)));
Invoke(new Action(() => listBox3.Items.Add(Scan[i].SSID)));
msg = string.Empty;
list.Clear();
private void richTextBox1_TextChanged(object sender, EventArgs e)
private void comboBox1_SelectedIndexChanged(object sender, EventArgs e)
private void richTextBox2_TextChanged(object sender, EventArgs e)
private void listBox1_SelectedIndexChanged(object sender, EventArgs e)
private void Form1_Load(object sender, EventArgs e)
public SqlConnection con = new SqlConnection(@"Data Source=(LocalDB)\v11.0;AttachDbFilename=|DataDirectory|\AP_SCAN_DATA.mdf;Integrated Security=True");
private void button3_Click(object sender, EventArgs e)
using (SqlConnection connection = new SqlConnection(@"Data Source=(LocalDB)\v11.0;AttachDbFilename=|DataDirectory|\AP_SCAN_DATA.mdf;Integrated Security=True"))
using (SqlCommand command = new SqlCommand())
command.Connection = connection; // <== lacking
command.CommandType = CommandType.Text;
command.CommandText = "INSERT into LOCATIONSCAN ((Scan[i].SSID),(Scan[i].MAC), (Scan[i].RSSi)) VALUES (@SSID, @MAC, @RSSi)";
command.Parameters.AddWithValue("@SSID", listBox1);
command.Parameters.AddWithValue("@MAC", listBox2);
command.Parameters.AddWithValue("@RSSi",listBox3);
try
connection.Open();
int recordsAffected = command.ExecuteNonQuery();
catch(SqlException)
// error here
finally
connection.Close();Hello,
Remove the Try-Catch as this hides any errors that may be raised. It is unwise to use a Try-Catch this way, always when using a Try-Catch write code that alerts or writes to a log file. Also, there is no need for invoke Close method for the connection object,
the Using statement closes the connection for you.
Please remember to mark the replies as answers if they help and unmark them if they provide no help, this will help others who are looking for solutions to the same or similar problem. -
Read XML data and Insert into SQL Database
Hi Everybody,
i am new to Oracle SOA.
Can anybody help me out to how to insert xml data into sql server using BPEL and JDeveloper (with clear steps).
thanks in advance
Vishnu KumarHi Peter,
you are right,at high level i was able to figure at these things.
But i don't know how to implement it using jdeveloper.
It will be more helpful if you can give me detailed steps to do it.
Thanks
Vishnu Kumar -
Error upon inserting data in sql Database using stream analytics job: Datatye error conversion
I have a data passed into the Event Hubs, queried by stream analytic job inserting it into sql database. Upon running the job, it becomes idle a few seconds after since it has an error:
Message: Conversion from 0 to System.Boolean failed. 0 was of type - System.Int64.
Conversion from 0 to System.Boolean failed. 0 was of type - System.Int64. Exception message at level [1], exception number [0], parent exception number [0]: Conversion from 0 to System.Boolean failed. 0 was of type - System.Int64.
The data type in one of my field(IsHistorical) is Boolean with a value of false. The data type of the column in the sql table where this is to be inserted is of type bit. In this case, it seems that stream analytics could not convert the value "false"
into a bit data type when inserting in sql table.
I'm wondering if you already have encountered this problem. Could you help me resolve this problem?
Thank you.Azure Stream Analytics does not have Boolean type. On input we will convert JSON Boolean value to bigint.
Here is the list of supported types and conversions:
https://msdn.microsoft.com/en-us/library/azure/dn835065.aspx
You can fix this erro by changing column type from bit to int in SQL table schema. -
Hi,
I am using xMII v 11.5..I need to insert into SQL database.
In BLS
Step 1:I am using an SQL Query1 it fetches data
Step 2: I am using 4 calculation Action block to calculate the values
Step 3: I am inserting the Calculated values using an SQL Query2
In the links when i evaluate its showing the value but when i check in the SQL Database it has inserted zeros...
I found that the first Query is not returning anything if i have set the Date condition in where clause...
Regards
Sweety
Edited by: sweety_VA on Apr 25, 2011 7:32 AMHi Sweety,
Can you provide some more information?
The script for each of your queries. (looking especially at how you are using single quotes around the Param properties for different data types)
Are you using an Command SQL Query for the insert?
Why are you using the Calculation action block instead of using the Expression Editor for the calculation?
Regards,
Mike -
I want to use the SQL Toolkit of NI and SQL Server as my databasis on a server. Do I need to install a client in each computer I want to handle the data into SQL tables or I need only a ODBC driver?
You only need the ODBC driver on each computer. If you are distributing the SQL Toolkit app as an executable and do not install the whole toolkit on each computer, you'll need the SQL Toolkit support files. This is about a dozen files. You can get the list at http://digital.ni.com/public.nsf/websearch/b814be005f9da9258625658700550c75?OpenDocument.
-
HOW TO INSERT DATA INTO SQL SERVER FROM MS ACCESS TABLE??
NEED TO INSERT DATA INTO SQL SERVER FROM MS ACCESS TABLE.
this is another method
http://www.mssqltips.com/sqlservertip/2484/import-data-from-microsoft-access-to-sql-server/
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs -
Data Type for saving Base64 image string into SQL database
Hi Team! I have image base64 string to be save into sql database. I use Varchar(MAX) data type. The problem is there are certain image string that cannot be enter (paste) into the table (due to the size) then i need to resize the image then i can paste
the string into the table. How to make all image string size be able to be save in the table? Or there is limit on the image size to be save into the table? I'm using mssql 2008. Thanks a lot.There is a limit of 2GB. Which means that the actual image size must be less, since you encode the image in Base64 for some reason.
Now, "pasting" strings is not the normal way to store data in an SQL Server database, so the question is a little funny. Normally data is stored in a database through a program of some sort. One way is to use OPENROWSET(BULK) as HuaMin suggested.
Here is a link to a simple example of how to do it from .NET:
http://www.sommarskog.se/blobload.txt
Erland Sommarskog, SQL Server MVP, [email protected] -
Updating array data in sql database
HI,
Im facing problems in updating array data in SQL database.
As of now, i am able to write an "insert" query and insert array data in an image datatype field. Im using image datatype because the array size is very big(around 80,000 x and y values).
Althoug inserting data is easy im unable to write a query to update this data.
Referring to the help of SQL server and Labview database connectivity toolkit, i came across a method of accessing image datatype....using textpointers, which are 16 bit binary values and using the WRITETEXT function instead of the UPDATE function.
but the problem im facing is that ive to pass the array as a 2d string array in the query as a result the updated array is retrieved in the form of a string a
nd not as an array. how do I get over this problem?Hi Pavitra,
I'm not very clear on how you have inserted the data into your application, but I do know that when you call the UPDATETEXT or WRITETEXT function you use the TEXTPOINTERS to point to the first location of a 1d array. So, depending on how you've stored the data, you may have problems updating your data if you're looking at it as a 1d array instead of how you originally formatted it. If you are able to successfully access the data as a 1d array, you can use the database variant to data type vi and pass in a string array constant for the data type. This will convert the variant datatype into whatever you specify. You may have to index the row and column of the variant (you receive a 2d array of variant) first before you convert. If possible, can yo
u provide some more detail and maybe some example code of how you perform the insert and plan to do the update? I can probably give you a better solution if I know how you are formatting the data. Thanks!
Jeremy L.
National Instruments
Jeremy L.
National Instruments -
How to insert a image file into oracle database
hi all
can anyone guide me how to insert a image file into oracle database now
i have created table using
create table imagestore(image blob);
but when inserting i totally lost don't know what to do how to write query to insert image fileHi I don't have time to explain really, I did have to do this a while ago though so I will post a code snippet. This is using the commons file upload framework.
Firstly you need a multi part form data (if you are using a web page). If you are not using a web page ignore this bit.
out.println("<form name=\"imgFrm\" method=\"post\" enctype=\"multipart/form-data\" action=\"FileUploadServlet?thisPageAction=reloaded\" onSubmit=\"return submitForm();\"><input type=\"FILE\" name=\"imgSource\" size='60' class='smalltext' onKeyPress='return stopUserInput();' onKeyUp='stopUserInput();' onKeyDown='stopUserInput();' onMouseDown='noMouseDown(event);'>");
out.println(" <input type='submit' name='submit' value='Submit' class='smalltext'>");
out.println("</form>"); Import this once you have the jar file:
import org.apache.commons.fileupload.*;Now a method I wrote to upload the file. I am not saying that this is correct, or its the best way to do this. I am just saying it works for me.
private boolean uploadFile(HttpServletRequest request, HttpSession session) throws Exception {
boolean result = true;
String fileName = null;
byte fileData[] = null;
String fileUploadError = null;
String imageType = "";
String error = "";
DiskFileUpload fb = new DiskFileUpload();
List fileItems = fb.parseRequest(request);
Iterator it = fileItems.iterator();
while(it.hasNext()){
FileItem fileItem = (FileItem)it.next();
if (!fileItem.isFormField()) {
fileName = fileItem.getName();
fileData = fileItem.get();
// Get the imageType from the filename extension
if (fileName != null) {
int dotPos = fileName.indexOf('.');
if (dotPos >= 0 && dotPos != fileName.length()-1) {
imageType = fileName.substring(dotPos+1).toLowerCase();
if (imageType.equals("jpg")) {
imageType = "jpeg";
String filePath = request.getParameter("FILE_PATH");
session.setAttribute("filePath", filePath);
session.setAttribute("fileData", fileData);
session.setAttribute("fileName", fileName);
session.setAttribute("imageType", imageType);
return result;
} And now finally the method to actually write the file to the database:
private int writeImageFile(byte[] fileData, String fileName, String imageType, String mode, Integer signatureIDIn, HttpServletRequest request) throws Exception {
//If the previous code found a file that can be uploaded then
//save it into the database via a pstmt
String sql = "";
UtilDBquery udbq = getUser(request).connectToDatabase();
Connection con = null;
int signatureID = 0;
PreparedStatement pstmt = null;
try {
udbq.setUsePreparedStatements(true);
con = udbq.getPooledConnection();
con.setAutoCommit(false);
if((!mode.equals("U")) || (mode.equals("U") && signatureIDIn == 0)) {
sql = "SELECT SEQ_SIGNATURE_ID.nextval FROM DUAL";
pstmt = con.prepareStatement(sql);
ResultSet rs = pstmt.executeQuery();
while(rs.next()) {
signatureID = rs.getInt(1);
if (fileName != null && imageType != null) {
sql = "INSERT INTO T_SIGNATURE (SIGNATURE_ID, SIGNATURE) values (?,?)";
InputStream is2 = new ByteArrayInputStream(fileData);
pstmt = con.prepareStatement(sql);
pstmt.setInt(1, signatureID);
pstmt.setBinaryStream(2, is2, (int)(fileData.length));
pstmt.executeUpdate();
pstmt.close();
con.commit();
con = null;
if(mode.equals("U") && signatureIDIn != 0) {
signatureID = signatureIDIn.intValue();
if (fileName != null && imageType != null) {
sql = "UPDATE T_SIGNATURE SET SIGNATURE = ? WHERE SIGNATURE_ID = ?";
InputStream is2 = new ByteArrayInputStream(fileData);
pstmt = con.prepareStatement(sql);
pstmt.setBinaryStream(1, is2, (int)(fileData.length));
pstmt.setInt(2, signatureID);
pstmt.executeUpdate();
pstmt.close();
con.commit();
con = null;
} catch (Exception e) {
con = null;
throw new Exception(e.toString());
return signatureID;
} -
Importing Data into Sql Server 2012 from Excel Data
Hi,
I got errors like this when i am doing import data into sql server from excel Data. Can you please help us?
- Executing (Error)
Messages
Error 0xc020901c: Data Flow Task 1: There was an error with Source - demotable$.Outputs[Excel Source Output].Columns[Comment] on Source - demotable$.Outputs[Excel Source Output]. The column status returned was: "Text was truncated or one
or more characters had no match in the target code page.".
(SQL Server Import and Export Wizard)
Error 0xc020902a: Data Flow Task 1: The "Source - demotable$.Outputs[Excel Source Output].Columns[Comment]" failed because truncation occurred, and the truncation row disposition on "Source - demotable$.Outputs[Excel Source Output].Columns[Comment]"
specifies failure on truncation. A truncation error occurred on the specified object of the specified component.
(SQL Server Import and Export Wizard)
Error 0xc0047038: Data Flow Task 1: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on Source - demotable$ returned error code 0xC020902A. The component returned a failure code when the pipeline engine called PrimeOutput().
The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
(SQL Server Import and Export Wizard)Are you attempting to import into a newly made table or into an existing table? It looks like it's trying to insert data where it cannot be inserted (invalid column or lack of data size in your column).
Try the following:
1). In your excel sheet, highlight the whole sheet and make sure the cells are in 'text' form and try re-importing
2). save the document as ms dos TEXT and import as a text document.
3). double check your columns are correct for the data, for example if you have a column that has a string of 100 characters and your column is 'NvarChar(90)' - that might cause the error? Or just correct data type in your column
3). If that doesn't work and you're inserting into a new table, try importing it as string first and writing a query to insert columns that should be float/integer or whatever. You may want to convert float texts to a 'bigint' first rather than string
> float as that can cause problems if I remember correctly. -
Does SSIS guarantee that it loads the data into SQL Server in the same order as it is in Excel
Hi,
We are trying to load several Excel files into SQL Server SSIS and we need to save the data in the database in the same order as it is in Excel..
My question is, Does SSIS guarantee that it loads the data into SQL Server in the same order as it is in Excel. If so, we will add a sequence to ensure we have the order.
Please advise.
Thanks & Regards,
DhanumjayThanks for your response.
If it is one file then we can add an index column, but we have to load hundreds of files.
How adding an index/key column to the table works unless SSIS picks and loads the data in the table in the same order as it is in Excel?
Just to explain my question better,
If excel has three rows {a,b},{c,d},{e,f}, does SSIS ensure it loads the data in the same order in a table.
Thanks. -
How to insert a table data into temporary table
Hi
Can anyone help me to insert a table data into temporary table.
Thanks
NavinIf you could provide a (simplified) example of the data you have and the output you're attempting to get, that would probably be quite helpful. I'm not sure that I understand exactly what you're trying to do here...
1) It sounds like you know the structure of the result set you're trying to generate. So it would be possible to create a temporary table once (at the same time that you create all your other tables) and write procedural PL/SQL code that would step through the data, write data to the temp table, select the data out of the temp table, and return a REF CURSOR. That would tend not to be the way that an Oracle developer would do things (there are exceptions, of course), but it would work.
2) I don't see any inherent problems in using sub-selects and inline views to do whatever aggregation you're trying to do on the secondary tables, which would allow you to get the output in a single query. For example, given an ORDERS table and an ORDER_DETAILS table,
SELECT o.customer_id, o.invoice_number, SUM( od.line_item_cost ) total_cost
FROM orders o,
order_details od
WHERE o.order_id = od.order_id
GROUP BY o.customer_id, o.invoice_number3) If you do need to use procedural logic, I would tend to look into the use of pipelined table functions or to read the data into an in-memory collection and to manipulate and return that collection.
Justin
Maybe you are looking for
-
Can V find Master data datasource by having Transaction data datasource?
Hello All I have a datasource in r/3 side by this can v find Master data datasource? The Transaction datasource is 2lis_02_scl? how to find Master datasource for this? Many Thanks balaji
-
Since downloading 5.1.1, my Touch 3G has "Reading List" in the Bookmarks section and the "history" tab no longer shows anything. How do I delete "reading list" in the bookmarks section? Very disappointed to have this pushed on me without warning. T
-
I have loaded photoshop 11. when I click on the application, it briefly loads and then closes.
-
How to display the page no in script
HI, Can any one tell how to display the page no's as follows in Scripts. current page/total no.of pages(ex:1/10)
-
Can I crop painted lines in Illustrator using pathfinder?
Hi everyone, This is a question from a total Illustrator newbie but I've been Googling like mad to no avail, so any help would be much appreciated! I'm experimenting with creating seamless patterns using shapes. I know how to crop shapes using the pa