Flat file with different layouts in a single file
Hello Friends,
Good Morning.
I am new to ODI - Oralce Data Integrator 11G.
I have a flat file where I had to load the flat file data to a oracle DB ( 11G ).
The flat file has 5 different layouts ( Data of 5 different suppliers coming as a single file and each layout is different ) and each layout corrresponds to one supplier information.
I had to load each layout data into a different table using a single source file ( That has all supplier information).
Please advice.
Thanks/Kumar
Ok below are the layouts.
BASE record
DS01 record
RM01 record
CR01 record
NW01 record
Few more question to you.
Are they always come in sequential like below ?
BASE record
DS01 record
RM01 record
CR01 record
NW01 record
BASE record
DS01 record
RM01 record
CR01 record
NW01 record
BASE record
DS01 record
RM01 record
CR01 record
NW01 record
Do you want only insert or insert/update as well ?
Similar Messages
-
Search multiple folders for files with same name and create single file
I have a project where I need to search multiple folders for a file name and when found append data from each file to a single input file.
Example
root folder to start search
\\servera\sales
\\servera\it\salesa\cmmstr.txt
\\servera\it\salesb\cmmstr.txt
\\servera\it\salesc\cmmstr.txt
I need to create a a single cmmstr.txt on the root folder. I would like it to be able to run this with parms to pass in folders to search and file names to search and single file name to create. I'm going to have a least 10 differnt files to
search for and create output file for. The folders to search
will somewhat be static.
Thanks.I tested this out on my own seat and I think it should work for you. I wrote it as a function, all you have to do is pass the root folders you want to search and the file your looking for. The function will then search that directory and all sub directories
for that file name. you will also have to provide it a file to append to, if the file dosen't exists the function will create it. If you run into an issues let me know and the links Mike
Laughlin posted are a great resource.
Function Search-Files{
Param([String[]]$Locations, $SearchFor, $AppendTo)
Begin
If(-Not (Test-Path $AppendTo)){New-Item $AppendTo -ItemType File -Force}
Process
ForEach($Location in $Locations)
$Files = Get-ChildItem -Path $Location -Filter $SearchFor -Recurse
ForEach($File in $Files)
Get-Content -Path $FIles.FullName | Out-File $AppendTo -Append
End{}
Search-Files -Locations "\\Server1\c$\Temp", "\\Server1\c$\Test1" -SearchFor "Install.cmd" -AppendTo "C:\Temp\Search.log" -
Trace file with different name is alert log file.
I am strange today
i found a trace file generated in alert log file with name
/bdump/stlbas_cjq0_1880.trc:
but when i am trying to find out in bdump folder i cannot found
any file with this named. instead i found /bdump/stlbas_cjq0_1853.trc
is there any possibility of being this scenario ?
database version:- 10.2.0.4
Os:- sun solaries spark 64 bits
Regards
HalimThe trace file has been removed/deleted from an OS user. I think you should verify that with OS logs.
Thanks -
How do I transfer a Numbers file with different tabs to an excel file?
Hello
I am a teacher and for each class I have a file in numbers. In each file I have different tabs for each period. Now I want to tranfer my files to my Macbook to print them out but from each file there is only one tab tranfered. How can I transfer all the tabs from each file? I transfer my files trough ITunes.
help me please!Looks like I should be more careful when reading. You did post in the iOS forum (in which case I expect most people here have iOS devices). I do apologize for not being more carfeul.
Here is a link to an APPLE web page that may help you transfer the document using iTunes:
http://support.apple.com/kb/HT4088
I hope this helps!
Regards,
Wayne -
Can you add to the Lightroom an ability to process several raw files with the same content but with different exposure into the single picture?
Base raw files can be given with exposure bracketing during shooting, for example.
The goal - to get maximum details in darks and lights (if we use the "ligths recovery" or "fill lights" we lose the quality because raw file just have no all required information).
The similar (but not the same, only the idea) thing - is High Dynamic Range Photography in Adobe Photoshop
Thank youThe plugin LR/Enfuse does this already. And of course Photomatix have a plugin available for Lightroom. This essentially amounts to pixel editing, which is beyond the range of Lightroom's metadata editing.
-
SSIS project - read multiple flat files with different formats
hi all,
i need to import multiple flat files with different formats into different tables of the sql server database and not able to figure out the best way out in ssis to do so...
please advise the possible methods in ssis to do so and if possible the process which can be dynamic as file names or columns might change in future.Hi AK1987,
To import flat files with dynamic columns, we can use Script Task inside a Foreach Loop Container to parse the first row of the flat file to get the columns names and save them into a .NET variable, then, we can create “Create Table” script based on this
variable, and then store the script into a SSIS package variable. After that, we create a staging table based on the package variable, load the flat file data to the staging table. Eventually, we load data from the staging table to the destination table. For
the detail steps, please walk through the following blog:
http://www.citagus.com/citagus/blog/importing-from-flat-file-with-dynamic-columns/
Regards,
Mike Yin
TechNet Community Support -
SSIS - Import Multiple flat files with different metadata
Hi ,
I have set of flat files with different metadata structure, I would like to load them into staging tables.
1. ) Can we load the flatfiles into the staging tables with out having multiple data flow task.
2.) If possible , can we programmatically select the staging table based on the metadata of the flatfile and load them.
Please advise.
Thanks
ThiyaNope in SSIS a data flow task needs to have a fixed metadata. So if your file metadata varies then best option would be use OPENROWSET syntax to pull the data and populate into your staging table. You may also use
SELECT .. INTO StagingTable ... FROM OPENROWSET (...)
syntax to create staging table at runtime based on the file metadata
http://sqlmate.wordpress.com/2012/08/09/use-your-text-csv-files-in-your-queries-via-openrowset/
If you want to do this in SSIS you need to create data flow dynamically using script task and build the metadata
see
http://www.selectsifiso.net/?p=288
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs -
How can i compare two excel files with different no. of records.
Hi
I am on to a small project that involves us to compare two excel files. i am able to do it but am struck up at a point. When i compare 2 different .csv files with different no. of lines i am only able to compare upto a point till when the number of lines is same in both the files.
Eg. if source file has 8 lines and target file has 12 lines. The difference is displayed only till 8 lines and the remaining 4 lines in source lines are not shown.
Can you help me in displaying those extra 4 lines in source file. I am attaching my code snippet below..
while (((strLine = br.readLine()) != null) && ((strLine1 = br1.readLine())) != null)
String delims = "[;,\t,,,|]";
String[] tokens = strLine.split(delims);
String[] tokens1 = strLine1.split(delims);
if (tokens.length > tokens1.length)
for (int i = 0; i < tokens.length; i++) {
try {
if (!tokens.equals(tokens1[i])) {
System.out.println(tokens[i] + "<----->" + tokens1[i]);
out.write(sno + " \t" + lineNo1 + " \t\t" + tokens[i] + "\t\t\t\t" + tokens1[i]);
out.println();
sno++;
} catch (Exception exception)
out.write(sno + " \t" + lineNo1 + " \t\t" + tokens[i] + "\t\t\t\t" + "");
out.println();
Thanks & RegardsA CSV file is not an Excel file.
But apart from that your logic makes no sense.
If the 2 files are of different sizes the files are different by definition, so further comparison isn't needed, you're done.
If you want to compare individual records, you need to compare all records from one file with all records from the other, unless the order of records is important in which case your current system might work.
That system however is overly complicated for comparing CSV files.
As you assume a single record per line, and if one can assume those records to have identical layout (so no leading or trailing whitespace in or between columns in one file that's not in the other) comparing records is simply a matter of comparing the entire lines. -
From sap to excel file with different sheets?
can i upload an internal table from SAP to single Excel file with different sheets for example like : sheet1, sheet2, sheet3.......sheet10. , but need to upload data from sap to excel worksheets ie. from multiple named tabs in Excel. Is this possible, and if so, please can you help and advise me how?
thanks
venkat.
Edited by: Matt on Feb 16, 2009 2:15 PM Removed excessive question marks...!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!Hi venkat,
Yes indeed it is possible to write data from internal table to different excel sheets. Check out SAP's Microsoft OLE functionality.Search on SDN for OLE . Following are some links
https://www.sdn.sap.com/irj/scn/wiki?path=/display/abap/sample%252bprogram%252bto%252bopen%252bexcel%252bsheet%252busing%252bole
You can also check out FM ALSM_EXCEL_TO_INTERNAL_TABLE to check how to read different worksheets.
Using the above two resources you can create a program that can upload data to multiple worksheets in the same workbook.
Also see this link
Creating Excel with More than one page
Edited by: aditya aghor on Feb 16, 2009 1:57 PM
Edited by: aditya aghor on Feb 16, 2009 2:02 PM -
Issues with multiple Files with multiple subdbs on a single environment.
I'm having an issue with Berkeley DB 4.2 on 32-bit platforms, regarding multiple physical files with multiple subdatabases in a single database environment. Specifically, when I open a subdatabase for a physical file, Berkeley DB thinks that it is using the same subdatabase in a different physical file.
I'm doing the following:
1. Create and open a db enviornment.
2. Move file1 to the common area.
3. Open, get and close the subdatabases in file1.
4. Move file2 to the common area.
5. Open, get and close the subdatabases in file2.
6. remove file2 from the common area
7. Move file3 to the common area.
8. Open a subdatabase from file3. About 1/2 the time, the fetches
return data from file2, not from file3.
It's possible that at some earlier time (i.e. before step 1 of this
test case), file1, file2 and file3 were the same file. I noticed
that there is something called env->fileid_reset, but that is not
in 4.2.52.
Any ideas?Looks like I've resolved the issue
-
I have pdf file with 500 pages created from AutoCad file. In all pages, I have different document numbers.The file is not editable in pdf. How to change all the document numbers using "Comment" feature? Any alternate method? alternate method? I have Adobe Acrobat X Pro and Windows -7 platform.
Yes, I just want to cover up all the pages for those particular area of document numbers.
Nothing sensitive about it. I just want to show the correct document numbers on all pages in print out.
So, I wanted to cover up by comments, but commenting on each page will be difficult. So, I wanted to comment the same on all pages. -
Reading fixed length file with different record types
Hi,
I need to read a fixed-length file with different record types, but the record identifier is in 31st position and not in 1st position.
But if I give 31 as position in File adpater wizard, BPEL takes whole 1-31 as identifier.
How we need to read such files.
Thanks
Ravdeephi ,
u cannot use the default wzard for this
use some thing like this nxsd:lookAhead="30" nxsd:lookFor="S"have a look at the below link it has some examples
http://download.oracle.com/docs/cd/B31017_01/integrate.1013/b28994/nfb.htm -
How to generate a second csv file with different report columns selected?
Hi. Everybody:
How to generate a second csv file with different report columns selected?
The first csv file is easy (report attributes -> report export -> enable CSV output Yes). However, our users demand 2 csv files with different report columns selected to meet their different needs.
(The users don't want to have one csv file with all report columns included. They just want to get whatever they need directly, no extra columns)
Thank you for any help!
MZHello,
I'm doing it usually. Typically example would be in the report only the column "FIRST_NAME" and "LAST_NAME" displayed whereas
in the csv exported with the UTL_FILE the complete address (street, housenumber, additions, zip, town, state ... ) is written, these things are needed e.g. the form letters.
You do not need another page, just an additional button named e.g. "export_to_csv" on your report page.
The csv export itself is handled from a plsql procedure "stored procedure" ( I like to have business logic outside of apex) which is invoked by pressing the button "export_to_csv". Of course the stored procedure can handle also parameters
An example code would be something like
PROCEDURE srn_brief_mitglieder (
p_start_mg_nr IN NUMBER,
p_ende_mg_nr IN NUMBER
AS
export_file UTL_FILE.FILE_TYPE;
l_line VARCHAR2(20000);
l_lfd NUMBER;
l_dateiname VARCHAR2(100);
l_datum VARCHAR2(20);
l_hilfe VARCHAR2(20);
CURSOR c1 IS
SELECT
MG_NR
,TO_CHAR(MG_BEITRITT,'dd.mm.yyyy') AS MG_BEITRITT ,TO_CHAR(MG_AUFNAHME,'dd.mm.yyyy') AS MG_AUFNAHME
,MG_ANREDE ,MG_TITEL ,MG_NACHNAME ,MG_VORNAME
,MG_STRASSE ,MG_HNR ,MG_ZUSATZ ,MG_PLZ ,MG_ORT
FROM MITGLIEDER
WHERE MG_NR >= p_start_mg_nr
AND MG_NR <= p_ende_mg_nr
--WHERE ROWNUM < 10
ORDER BY MG_NR;
BEGIN
SELECT TO_CHAR(SYSDATE, 'yyyy_mm_dd' ) INTO l_datum FROM DUAL;
SELECT TO_CHAR(SYSDATE, 'hh24miss' ) INTO l_hilfe FROM DUAL;
l_datum := l_datum||'_'||l_hilfe;
--DBMS_OUTPUT.PUT_LINE ( l_datum);
l_dateiname := 'SRNBRIEF_MITGLIEDER_'||l_datum||'.CSV';
--DBMS_OUTPUT.PUT_LINE ( l_dateiname);
export_file := UTL_FILE.FOPEN('EXPORTDIR', l_dateiname, 'W');
l_line := '';
--HEADER
l_line := '"NR"|"BEITRITT"|"AUFNAHME"|"ANREDE"|"TITEL"|"NACHNAME"|"VORNAME"';
l_line := l_line||'|"STRASSE"|"HNR"|"ZUSATZ"|"PLZ"|"ORT"';
UTL_FILE.PUT_LINE(export_file, l_line);
FOR rec IN c1
LOOP
l_line := '"'||rec.MG_NR||'"';
l_line := l_line||'|"'||rec.MG_BEITRITT||'"|"' ||rec.MG_AUFNAHME||'"';
l_line := l_line||'|"'||rec.MG_ANREDE||'"|"'||rec.MG_TITEL||'"|"'||rec.MG_NACHNAME||'"|"'||rec.MG_VORNAME||'"';
l_line := l_line||'|"'||rec.MG_STRASSE||'"|"'||rec.MG_HNR||'"|"'||rec.MG_ZUSATZ||'"|"'||rec.MG_PLZ||'"|"'||rec.MG_ORT||'"';
-- DBMS_OUTPUT.PUT_LINE (l_line);
-- in datei schreiben
UTL_FILE.PUT_LINE(export_file, l_line);
END LOOP;
UTL_FILE.FCLOSE(export_file);
END srn_brief_mitglieder;Edited by: wucis on Nov 6, 2011 9:09 AM -
How to create PDF from text file with specific layout?
I wanted to create the pdf from text file in specific layout - Landscape orientation and JIS B3 Page size while at Adobe Acrobat Pro.
In past, I could do a right click on a text file (desktop area) and select print to print out the document into .pdf BUT only if I set the Adobe PDF to Landscape and JIS B3 Page size BEFORE. And I could only do 15 text documents at once.
I wanted to see if I could do the create the pdf from text file with specific layout in Adobe Acrobat without having to go to Control Panel to preset the Adobe PDF to specific layout at every time. I would have to set Adobe PDF back to normal layout after I'm done with these pdf print outs. I do lots of pdfs in normal layout. Sometimes I would forget to do that.
So, How do I do that?No such luck. It would output the contents in letter size even in JIS B3 Page layout at MS word.
Is there a script or action where I could set the orientation and page size before creating PDF on these text files? -
Creating pdf-file from multiple files with different orientation
How do I put together two files with different orientation in the page set up so that the lying A4-format is standing up in the new pdf-file?
lophelia wrote:
How do I put together two files with different orientation in the page set up so that the lying A4-format is standing up in the new pdf-file?
First I've underline a Phrase in your Question did you mean underlying A4-format?
Are both PDF Files created with A4-Format? If yes then:
Did you shift orientation to Portriat Format for the item(s) that you need, such as a Chart or an excel Document? If so:
Then when the documents are meged They should print correctly.
Maybe you are looking for
-
How to include the OBI reports in other web applications such as flex.
I am currently working in Flex and java. I learnt the basics of OBI and constructed some reports. Now i want to include these reports in my Flex application as a part of dashboard. I want to know the way of doing it....
-
How to get the first 6 digits and the last 4 digits in a string ?
Greetings folks. A quick question and probably quite simple for a lot of guys out there. I have a string that could be anywhere between 15 to 20 characters ( Not a fixed length ) I want it to be split into 3 segments. Segment 1 : 123456 ( 6 digits )
-
I go to buy a song and says that my ID has not been used in the I Tunes store . So what do i have to do to buy music ?
-
i have some fields of datatype curr and domain wertv6/wertv7...which has 2 decimal places.. but in my screen i'm getting 5 decimal places for all those fields....how is this happening?
-
Delivery unit in material master should appear on item level of delivery
Dear SD Sales and Delivery experts, i would appreciate your support very much!!! We want to implement the following small functionality: The components concerned are material master, order and delivery item. The material master is maintained in folde