Flat file to SQL BizTalk Server

Hi,
Currently I have a requirement in my project to import flat file data to multiple SQL tables using BizTalk. As of now I am doing the following steps :
1. Prepare a input schema using flat file schema wizard
2. Prepare a Output schema(creating a SQL Procedure) using WCF-SQL Adapter
3. Map from input schema to output schema
As of now I make multiple calls to the procedure for insertion, Is it possible to perform a bulk insertion into multiple tables ? Is there any other alternative apart from creating a procedure and inserting the data?
Thanks,
Chaithanya

Hi All,
Thanks for your suggestions.
@Abhishek : "You are not passing correct message to SQL for its processing . check
your Orchestration whether you are sending the correct transformed SQL message from Biz Talk or not which is confined to the schema of the SQL."
Mapping Details :
Please find the details of stored proc below :
CREATE PROC [dbo].[MyProcedure]
@XML XML
AS
BEGIN
SELECT FirstColumn = Col1[1],
SecondColumn = Col2[1]
FROM @Xml.nodes('RootNode/Header')
END
Can you please tell me if I am missing out anything from the above mapping & stored proc details?

Similar Messages

Copying TEXT column from flat file into SQL results in empty fields....

I'm copying TEXT column from SQL to Flat file (ragged right fixed width) - DT_TEXT. It copies fine and I''ve checked the output file. Now, while trying to copy the flat file to sql server in another system. I find all the fields are empty.
When I preview the source from flatfile, I see all the entries there. But it copies other fields but the field with DT_TEXT is empty.
This is when I preview
SQL Table output
Any help will be helpful!!!

Hi, I'm not sure If I'm understanding what you're saying. The data got copied from SQL to Flat file. I've double checked the flat file and I see the DT_TEXT data there. The size of file also gives an indication that there's existence of TEXT Data
But, when I copy that data back to sql again (which I can also preview before the load), The DT_TEXT values goes missing. Same when I copy to Excel as CSV or as a Flat file. I don't see text data.
The TEXT data resides on the first output. But when I try to extract to other format from that output, it doesn't come out.

To read flat file from a unix server

We need to read a flat file from a Unix server, where our Database is located.
The location gets created correctly.
But while we are trying to import files from the location in Design Center , we get an error that "directory does not exists", although the directory has all the permissions.
Can someone please suggest how should we create the location so as it can read the files.
Please Reply ASAP......

We have started Design Center on a local machine(Windows Machine) with uaer as repository owner of the server,
In the design center we can not sample the file till we import it,
can you please tell how to sampe the file without importing it.
Also a location pointing to server location gets easily created on the design center and the file module points to that location only, but when we try to import the file through that location, it says directory does not exists, although oracle user has all the read write permissions on the directory......
Please help!

Issue importing flat files into SQL server 2008R2

I have csv files that the last column may not have data. SSIS (version 2008R2) will insert the next row's data into the empty cells, which causes my package to fail.
I know this is resolved in 2012 but we are using 2008R2 still. Any suggestions?
Thanks.

Hi sqlBI2014,
After testing the issue that Flat File Connection Manager cannot handle file with uneven number of columns in each row in my SQL Server 2008 R2 environment, I can reproduce it.
Based on my research, the issue is caused by the Column Delimiter gets first preference and then Row delimiter. So the next row data would be inserted in the empty column cell. This is by design in SQL Server 2005, SQL Server 2008 or SQL Server 2008 R2.
Good news is that the issue is fixed in SQL Server Data Tools which comes with SQL Server 2012. In SQL Server 2012, by default, the Flat File Connection Manager always checks for a row delimiter in unquoted data, and starts a new row when a row delimiter
is found. This enables the connection manager to correctly parse files with rows that are missing column fields.
If you still want to fix the issue in SQL Server 2008 R2, there is a sample component posted to the CodePlex that might help you with this:
http://ssisdfs.codeplex.com/
References:
http://blogs.msdn.com/b/dataaccesstechnologies/archive/2013/03/13/flat-file-source-cannot-handle-file-with-uneven-number-of-columns-in-each-row.aspx
https://connect.microsoft.com/SQLServer/feedback/details/293193/ssis-import-of-flat-file-with-uneven-number-of-columns
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Conversion of string to data(Flat file to sql server) Transformations

Hi All,
I have a requirement in which I am trying to convert a field of type string which contains date from source file to field of type datetime in sqlserver by using all the below expressions
to_date(DATE, 'yyyy/mm/dd-hh24:mi:ss' )
to_date(DATE, 'yyyy/mm/dd' )
However it is not throwing any errors but the data of the date field is being loaded with null values(Date is present in flat file).
Any inputs plz???
Thanks
U

Can you post a sample of the date string you are trying to convert?

Extra column to be added while importing data from flat file to SQL Server

I have 3 flat files with only one column in a table.
The file names are bars, mounds & mini-bars.
Table 'prd_type' has columns 'typeid' & 'typename' where typeid is auto-incremented and typename is bars, mounds & mini-bars.
I Import data from 3 files to prd_details table. This table has columns 'pid', 'typeid' & 'pname' where pid is auto-incremented and pname is mapped to flat files and get info from them, now i wanted the typeid info to be received from prd_type table.
Can someone please suggest me on this?

You can get it as follows
Assuming you've three separate data flow tasks for three files you can do this
1. Add a new column to pipeline using derived column transformation and hardcode it to bars, mounds or mini-bars depending on the source
2. Add a look task based on prd_type table. use query as
SELECT typeid,typename
FROM prd_type
Use full cache option
Add lookup based on derived column. new column -> prd_type.typename relationship. Select typeid as output column
3. In the final OLEDB destination task map the typeid column to tables typeid column.
In case you use single data flow task you need to include a logic based on filename or something to get the hardcoded type value as bars, mounds or mini-bars in the data pipeline
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Loading flat files located on a server using the Control Center piece ofOWB

Loading flat files from a server with OWB
I am successful loading files with OWB, as long as they resided on my workstation in the C:\ drive. I copied the files to a Linux server into directories owned by Oracle/oinstall, permissions on the directories containing the files are 777. I ran the OWB client from the server with the following results:
Error
RPE-01013: SQL Loader reported error condition, number 1.
SQL*Loader: Release 10.2.0.1.0 - Production on Fri Mar 9 11:15:58 2007
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL*Loader-500: Unable to open file (/u00/data/owb_repos1/state_codes.csv)
SQL*Loader-553: file not found
SQL*Loader-509: System error: The system cannot find the file specified.
SQL*Loader: Release 10.2.0.1.0 - Production on Fri Mar 9 11:15:58 2007
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL*Loader-500: Unable to open file (/u00/data/owb_repos1/state_codes.csv)
SQL*Loader-553: file not found
SQL*Loader-509: System error: The system cannot find the file specified.
I tried to load the file using the control center from both the windows client and the server client. Can I do this from either one?
I can't import the file in the Design Center from the /u00/data/owb_repos1 directory, it does not show up.
If anyone has received similiar errors from OWB, please tell me how I can fix this. THANKS!!!
[d97886@owbtest owb_repos1]$ pwd
/u00/data/owb_repos1
[d97886@owbtest owb_repos1]$ ls -la
total 24
drwxrwxrwx 2 oracle oinstall 4096 Mar 19 12:14 .
drwxrwxrwx 18 oracle oinstall 4096 Mar 6 16:41 ..
-rwxrwxrwx 1 oracle garrett 1481 Mar 8 07:32 state_codes.csv
[d97886@owbtest owb_repos1]$

Hi
This is what i do for my flat files (i am loading my tables from the flat files):
1) Create location for the files in OWB and it should look something like \\path_to_where_the_files_are. Here you should be able to browse to your Linux box and select the location of the files.
2) Then check whatever you use (i use TOAD) and you should see in owb schema a directory created there which points to the location of the flat file.
3) then just follow the guide to sample the files etc and you are good to go.
Basically OWB has to be able to see the files that are on Linux machine.
Alternatively you can map your Linux share to your windows box (use samba or something) and use it that way.
Sorry if it is stating the obvious.
Hope this helps
Kind Regards
Vix

Running reports on Flat file schemas when OBIEE server is on Unix

Hello
we would like to know how Unix OBIEE work with flat file. Currently, in our environment our Development and Production OBIEE are running on Unix AIX machine while our local OBIEE environment is on Windows.
As our devolepment and configuration goes, we have encounter situations where the flat file schema that were working well on Windows OBIEE server will not run on Unix. The flat files are located on a windows file directory and could be successfully imported into OBIEE throu Admin Tool.
However, when updating rowcounts or running reports on answers in Unix OBIEE it would return errors:
State: HY000. Code: 472983136. [NQODBC] [SQL_STATE: HY000] [nQSError: 10058] A general error has occurred. [nQSError: 16023] The ODBC function has returned an error. The database may not be available, or the network may be down. (HY000)
The same activity is working fine on our local machine when OBIEE is on windows..
We would like to get some help on how to work with flat files when OBIEE is runing on Unix..

is this the same question as [this one|http://forums.oracle.com/forums/message.jspa?messageID=4018049#4018049] ?

Moving of flat file from the application server after upload.

Hi All,
I am uploading data from a flat file placed on the application server by a BDC program.
After the BDC has created the session i want to transfer the flat file from that folder to another folder on the application server by changing the name of the flatfile.
Can any one suggest the best way of doing this particular scenario?
Thanks in advance.
Regards
Satish Nair.

Here is a sample program.
report zrich_0001.
data: d1 type localfile value '/usr/sap/TST/SYS/Data1.txt',
      d2 type localfile value '/usr/sap/TST/SYS/Data2.txt'.
data: begin of itab occurs 0,
      rec(20) type c,
      end of itab.
data: wa(20) type c.
start-of-selection.
open dataset d1 for input in text mode.
if sy-subrc = 0.
    do.
      read dataset d1 into wa.
      if sy-subrc <> 0.
        exit.
      endif.
      itab-rec = wa.
      append itab.
    enddo.
endif.
close dataset d1.
open dataset d2 for output in text mode.
loop at itab.
    transfer itab to d2.
endloop.
close dataset d2.
delete dataset d1.
Regards,
Rich Heilman

Loading Flat file in SQL Navigator

Hi, I am using SQL Navigator 5.5 Standard Edition. Please tell how to load a flat file using this tool.
Edited by: user637544 on 24-Jun-2009 01:14

So?
Toad : Not an Oracle product, but a Quest product
Sql Navigator: Not an Oracle product, but a Quest product
You should ask your questions in a vendor-related forum.
This is an Oracle forum. This is not a Quest forum.
Sybrand Bakker
Senior Oracle DBA

Flat file error : SQL :RSDU_TABLE_SPLIT_PARTITION_MSS

Hi Guys,
I have issues in flat file loading, Infopackage is failed with error.
The request is yellow in status in RSMO, though the relavane job got cancelled with "RSDU_TABLE_SPLIT_PARTITION_MSS: Error During SQL Execution for Table /BIC/FCUBE_NAME" reason.
Performed repair on the PSA table using RSRV and deleted old PSA data.
Even though, the load is getting failed.
Any help on this is appreciated.
Regards,
Jeelani

Hi Ramana,
I am experiencing similar issue, i still can't solve it, we are on SP16 with SQL 2005 platform, never experience such a problem until we have upgraded to SP16 from SP9, the following note explain explain something we do about it, but i don't like the solution. it seems SAP has handed over the infocube partition job to us to maintain rather then the system to do the job.I
Note 1008833 - Supplementary SAP Note about repartitioning
regards,

Not loading from flat file using SQL*Loader

Hi,
I am trying to load from an excel file.
first i converted excel file into csv file and save it as as dat file.
in the excel file one column is salary and the data is like $100,000
while converting xls to csv the salary is changed to "$100,000 " (with quotes and a space after the amount)
after the last digit it will put a space.
in the control file of sql*loader i had given
salary "to_number('L999,999')"
my problem is the space after the salary in the dat file.---> "$100,000 "
what changes i have to make in the to_number function which is in the control file.
Please guide me.
Thanks & Regards
Salih KM
Message was edited by:
kmsalih

Thanks a lot Jens Petersen
It's is loading ..........
MI means miniute.
am i correct.
but i didn't get the logic behind that.
can u please explain that.
Thanks & Regards
Salih KM

How we create a flat file on the application server

hi,
how we create a flat file on the application servere,this file have the header data and corresponding item data also.
i.e. how we use the AT NEW and ATEND. statement in this file creation.
pls send me some code related to this.
thanks,
vipin

Hi Grafl,
Chk this link
Folder creation in AL11 using ABAP program
try this code.This works on UNIX servers
data: unixcom like   rlgrap-filename.
data: begin of tabl occurs 500,
        line(400),
      end of tabl.
dir = unixcom = 'mkdir mydir'. "command to create dir
"to execute the unix command
call 'SYSTEM' id 'COMMAND' field unixcom
                  id 'TAB' field tabl[].
<b>Reward Points if Useful</b>
Regards
Gokul

How to Load Arabic Data from flat file using SQL Loader ?

Hi All,
We need to load Arabic data from an xls file to Oracle database, Request you to provide a very good note/step to achieve the same.
Below are the database parameters used
NLS_CHARACTERSET AR8ISO8859P6
nls_language american
DB version:-10g release 2
OS: rhel 5
Thanks in advance,
Satish

Try to save your XLS file into CSV format and set either NLS_LANG to the right value or use SQL*Loader control file parameter CHARACTERSET.
See http://download.oracle.com/docs/cd/B19306_01/server.102/b14215/ldr_control_file.htm#i1005287

Limit on the size of the flat file in SAP Application Server

Hi Gurus,
My requirement is to upload the account payable data to the SAP Application Server.
The requirement say's like if the size of the file exceeds the limit(is there any limit on file size in SAP?) of SAP then I should upload another file with the remaining records.
Is there any limit on the file size uploaded into SAP Application Server?If there is limit on file size then what is the value of the limit?
I guess the file size will depend on the basis configuration and the free size of the Application Server Folder.
How to check free space in the Application Server folder and proceed further for placing the file in that folder?
Thanks & Regards,
Kiran Kumar K

The limitation (if any) will be on the OS level. Nothing to do with SAP as such. Asking your basis team to provide you with an area with plenty of room will be the easiest option. How big are your files - most OSs can handle files of many GB. Sounds to me like the "requirement" has been written by someone without technical knowledge...

Flat file to SQL BizTalk Server

Similar Messages

Maybe you are looking for