How often in the real time projects extract data from flat files n process

I am going thru teh BODS data integrator, and trying to understand the demand of ETL services extract data from a flat file, is that really impt in teh real time jobs.
Thank you very much for the helpful info.

Hi,
As per the inputs given by you guys i started loading data from flat file.
I try to load 28 files from i which i was able to load 24 files succesfully.For the other 4 i got this error messages
1) Error 'Enter period in the format __.YYYY...' at conversion exit CONVERSION_EXIT_PERI6_INPUT (field CALMONTH record 1, value DUMYTRA)
Message no. RSDS012
2) a) Error 'The argument '1,008.00' cannot be interpreted as anumber' on assignment field QUANT_B record 11714 value 1,008.00
Message no. RSDS013
b) Error 'The argument '1,110.00' cannot be interpreted as anumber' on assignment field QUANT_B record 15374 value 1,110.00
Message no. RSDS013
3) a) Error 'The argument '1,140.00' cannot be interpreted as anumber' on assignment field QUANT_B record 1647 value 1,140.00
Message no. RSDS013
b) Error 'The argument '2,028.00' cannot be interpreted as anumber' on assignment field QUANT_B record 4625 value 2,028.00
Message no. RSDS013
4) Error 'The argument '1,151.00' cannot be interpreted as anumber' on assignment field QUANT_B record 7808 value 1,151.00
Message no. RSDS013
I'am unable to trace out what is the error exactly.
I checked this values in files they are perfect.
can anybody please guide me on this issue.
With Regards,
Pradeep.B

Similar Messages

BPC 7.5 will extract data from flat file or directly from cube

Hi,
i have a doubt plz give me a solution.
1) previously our BPC 7.0 team extracted data from BI 7.0 through flat file, but now they have upgraded to BPC 7.5 i want to know whether BPC 7.5 will extract directly from our BW infocube or not.
2) please let me know how data extracted from BPC 7.5.
Thanks and Regards
Satish

Hi,
If your import file has duplicate record in it then the Status of your DM package for import ends with warning, where all the records in your file might have got accepted but only one last data rows amoung the duplicate rows might have got submitted to the system.
The duplicate records will be rejected and you can see the list of duplicate records as well in the DM package status report.
Like Nilanjan said you can use Append DM Pacakge to submit all duplicate records aswell into the system. But here the problem is it appends the data in flat file with data available in the system.
Say you have 100 for account1 in the system and you run Append DM Package having values duplicate values for account1 say 100 and 200. So after the Append Package execution you will have 100100200= 400 for account1.
So for Append DM package to work in the same way as import, run clear package before executing the Append package.
Hope this helps,
Regards,
G.Vijaya Kumar

Extract data from Flat file CSV to SQL Server 2008 using SSIS 2008 (Data gets corrupted when extraction)

Hi,
I am trying to extract data from multiple CSV files to SQL into a single table. The data type of all the columns in SQL table is nvarchar(MAX). I am able to extract the data from the flat files but some of the data(on extraction) is
corrupt including question marks(?) and other invalid special characters. Also I tried selecting the UTF-8, 65001(Unicode) format but the problem still persists. Also I tried using data converter but no use.
I checked with the data in the flat file but there is no data with question mark(?) or any other special characters.
The separator in the flat file is Comma(,)
Please help.
Thanks in advace.

The source system and application determines the code page and encoding. Is it Windows, Unix, Mainframe or some other type?
Unicode files sometimes begin with a byte order mark (2 bytes) to indicate little or big endian. If you open the file in notepad and then select save as, the encoding in the dialog will show the encoding notepad detected based on the BOM. If
that is ANSI instead of Unicode or UTF-8, you will need to know the code page the source system used when the file was created.
Dan Guzman, SQL Server MVP, http://www.dbdelta.com

Extract data from flat file

Hi,
I'm trying to extract data from a non-SAP datasource (flat file) to BW, I need to first convert the source file (txt) into the appropriate format to load to BW (CSV or ASCII). Currently, the txt file is not in a either format but more in a report kind of format. Is there any functionality in BW that I could utilize to convert the source file esaily in the format that BW can understand? Can I do this using transfer rules?
Thanks.

Thanks. But on the text file, there's some other information that I don't need such as the header information and the data currently is in group level. Can I utilize BW without changing the format on the original source file?
Thanks.

STEPS REQUIRED TO EXTRACT DATA FROM FLAT FILE TO BI 7.0

HI ALL,
I NEED THE STEPS TO EXTRACTED THE DATA FROM A FLAT FILE TO BI 7.0
PLEASE PROVIDE ME THE STEPS RATHER THAN PROVIDEING ME THE COMPLETE LINK OF SAP HELP.
I NEED THE STEPS ONLY.
THANKS,
GAUTAM

BW 7.0
Uploading of master data
Log on to your SAP
Transaction code RSA1LEAD YOU TO MODELLING
1.     Creation of Info Objects
     In left panel select info object
     Create info area
     Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
     Create new characteristics and key figures under respective catalogs according to the project requirement
     Create required info objects and Activate.
2.     Creation of Data Source
     In the left panel select data sources
     Create application component(AC)
     Right click AC and create datasource
     Specify data source name, source system, and data type ( master data attributes, text, hierarchies)
     In general tab give short, medium, and long description.
     In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
     In proposal tab load example data and verify it.
     In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
     Activate data source and read preview data under preview tab.
     Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
3.     Creation of data targets
     In left panel select info provider
     Select created info area and right click to select Insert Characteristics as info provider
     Select required info object ( Ex : Employee ID)
     Under that info object select attributes
     Right click on attributes and select create transformation.
     In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
     Activate created transformation
     Create Data transfer process (DTP) by right clicking the master data attributes
     In extraction tab specify extraction mode ( full)
     In update tab specify error handling ( request green)
     Activate DTP and in execute tab click execute button to load data in data targets.
4.     Monitor
   Right Click data targets and select manage and in contents tab select contents to view the loaded data. Alternatively monitor icon can be used.
BW 7.0
Uploading of Transaction data
Log on to your SAP
Transaction code RSA1LEAD YOU TO MODELLING
5.     Creation of Info Objects
     In left panel select info object
     Create info area
     Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
     Create new characteristics and key figures under respective catalogs according to the project requirement
     Create required info objects and Activate.
6.     Creation of Data Source
     In the left panel select data sources
     Create application component(AC)
     Right click AC and create datasource
     Specify data source name, source system, and data type ( Transaction data )
     In general tab give short, medium, and long description.
     In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
     In proposal tab load example data and verify it.
     In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
     Activate data source and read preview data under preview tab.
     Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
7.     Creation of data targets
     In left panel select info provider
     Select created info area and right click to create ODS( Data store object ) or Cube.
     Specify name fro the ODS or cube and click create
     From the template window select the required characteristics and key figures and drag and drop it into the DATA FIELD and KEY FIELDS
     Click Activate.
     Right click on ODS or Cube and select create transformation.
     In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
     Activate created transformation
     Create Data transfer process (DTP) by right clicking the master data attributes
     In extraction tab specify extraction mode ( full)
     In update tab specify error handling ( request green)
     Activate DTP and in execute tab click execute button to load data in data targets.
8.     Monitor
   Right Click data targets and select manage and in contents tab select contents to view the loaded data. There are two tables in ODS new table and active table to load data from new table to active table you have to activate after selecting the loaded data . Alternatively monitor icon can be used
cheers
sunil

Extract data from Flat File in a remote machine

Hi All,
Can we extract the data from a flat file present in the Linux server ( same server having ODI installed ) and load it into the database. In most of the forms in the internet shows that the file is to be placed in the local client ( Eg:- C:/Flat_files/ ) .
Any thoughts on this is possible. Please provide me some information on the same.
Thanks and Regards,
Krishna Prasad

Many ways to do this. For example you could use sqlloader or a simple File to SQL and load from an agent used on the same machine of your file.
If your agent is not on the same box as the flat file, you will need a shared drive. Or you can first move the file using FTP or something like that.
Shared drive is quite easy but they are the evil. You'll need an everyone-read permission.
Let us know

Extracting data from flat file in OWB

Hi,
Does anyone know, how to run a mapping having source as flat file in OWB?
I am facing a problem as run button becomes disabled as it is SQL Loader script.
When I register the TCL script with OEM it doesn't pass the name of the CTL file
as parameter and so the job fails.
If anyone knows how to do it, please reply.
Regards
-Yogesh

Hi Bhavesh ,
The data type beimg given is of this format :
TLOG          Root Node     Structure     1..n
STORECODE
TILLID
TXDATE
POSTDATE
TXTIME
TXSERIAL
TXBATCH
DOCNO
VOIDDOCNO
TXTYPE
TXMSG
TMSG is the field conatinig the message ( stated in my mail ) .
Thanks
Anita Yadav

How to create BOM(Bill Of Material) item data from flat file?

I have two flat files one is BOM(Bill Of Material) header data and BOM item data. BOM header is already created, now I want to create BOM item data with reference to the header data. Is there any standard direct batch input method in LSMW or Is there any standard BAPI or Is there any standard BDC report program to do the task? CS01 is the TCode to create BOM.

Hi,
The DI program works for create step CS01 and not for CS02.
Perhaps this ( adding items in header by Tx: CS02 ) could be achieved by a Recording step in LSMW.
Best Regards, Murugesh

Can we use the AdventureWorks2008R2 data for the real time project.

Hi,
In our project we are trying to do the data scrambling on First name, last name and middle name...
In the regular practice we use to update the names as
First Name = FN+<PERSON_SNO>
Last Name = LN+<PERSON_SNO>
Middle Name = MN+<PERSON_SNO>
The Problem is the names are not looking realistic, so I thought of applying some logic and updating our PERSON table names based on Person.Person table in adventure works.
My question is can we use the AdventureWorks2008R2 data for the real time project. Is there any cop right issue.
Someone please help me solve this issue.
Thanks
Karthikeyan Jothi.

Please read this link content:
Adventure Works Sample Site
sqldevelop.wordpress.com

How can I join 3 tables while extracting data from SAP R/3?

I have 3 tables with the following columns
Emp table (emp)
emp_id
emp_name
emp_add
Dept table (dept)
dept_id
dept_name
dept_loc
Location table (loc)
loc_id
loc_name
Now. If I want to select data from loc_id = 10 and emp_id between 2000 and 3000
How to join these three tables while extracting data from R/3
join condition
loc.loc_id = dept.loc_id
and dept.dept_id = emp.dept_id
and loc.loc_id =10
and emp.emp_id between 2000 and 3000.
Could any one let me know the procedure to extract this data into BW system.

Hi,
shouldn't your join condition be:
loc.loc_id = dept.DEPT_LOC
and dept.dept_id = ??
If you can join the three tables then create a generic datasource (RSO) based on a view (create your view with your join in SE11).
Enable the loc_id and the emp_id as selectable in the datasource so you can then select the values from a BW IPack.
hope this helps...
Olivier.

How to extract data from XML file with JavaScript

HI All
I am new to this group.
Can anybody help me regarding XML.
I want to know How to extract data from XML file with JavaScript.
And also how to use API for XML
regards
Nagaraju

This is a Java forum.
JavaScript is something entirely different than Java, even though the names are similar.
Try another website with forums about JavaScript.
For example here: http://www.webdeveloper.com/forum/forumdisplay.php?s=&forumid=3

Hi, extract data from xml file and insert into another exiting xml file

i am searching code to extract data from xml file and insert into another exiting xml file by a java program. I understood it is easy to extract data from a xml file, and how ever without creating another xml file. We want to insert the extracted data into another exiting xml file. Suggestions?
1st xml file which has two lines(text1.xml)
<?xml version="1.0" encoding="iso-8859-1"?>
<xs:PrintDataRequest xmlns:xs="http://com.unisys.com/Anid"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://com.unisys.com/Anid file:ANIDWS.xsd">
<xs:Person>
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://com.unisys.com/Anid file:ANIDWS.xsd">
These two lines has to be inserted in the existing another xml(text 2.xml) file(at line 3 and 4)
Regards,
bubbly

Jadz_Core wrote:
RandomAccessFile? If you know where you want to insert it.Are you sure about this? If using this, the receiving file would have to have bytes inserted that exactly match the number of bytes replaced. I'm thinking that you'll likely have to stream through the second XML with a SAX parser and copy information (or insert new information) as you stream with an XML writer of some sort.

Extract data from xml file and insert into another exiting xml fil

hello,
i am searching extract data from xml file and insert into another exiting xml file by a java program. I understood it is easy to extract data from a xml file, and how ever without creating another xml file. We want to insert the extracted data into another exiting xml file. Suggestions?
Regards,
Zhuozhi

If the files are small, you can load the target file in a DOM document, insert the data from the source file and persist the DOM.
If the files are large, you probably want to use a StAX or SAX.

Extract data from XML file to Oracle database

Dear All
Please let me know, how to extract data from XML file to Oracle database which includes texts & images.
Thanking You
Regards Lakmal Marasinghe

I would do it from the database, but then again, I am a database / PL/SQL guy.
IMHO the database will deliver you with more options. I don't know about "speed" between the two.

Wrong century for the dates from flat file

I am in the process of uploading the data from flat file ( aka CSV) into oracle via external table .
All the dates have the year of 20xx. My understanding was 51-99 will be prefixed with 19 ( such as 1951 - 1999) and 00-50
will be prefixed with 20 ( such as 2004 ... )
The column below ( startdate ) is of timestamp .
Is my understanding wrong ?
SQL> select startdate , to_date(startdate , 'dd/mm/yyyy' ) newdate from tab;
NEW_DATE STARTDATE
09/18/2090 18-SEP-90 12.00.00.000000000 AM
BANNER
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production
PL/SQL Release 11.1.0.7.0 - Production
CORE 11.1.0.7.0 Production
TNS for 64-bit Windows: Version 11.1.0.7.0 - Production
NLSRTL Version 11.1.0.7.0 - Production
SQL> show parameter nls
NAME TYPE VALUE
nls_calendar string
nls_comp string BINARY
nls_currency string
nls_date_format string
nls_date_language string
nls_dual_currency string
nls_iso_currency string
nls_language string AMERICAN
nls_length_semantics string BYTE
nls_nchar_conv_excp string FALSE
nls_numeric_characters string
nls_sort string
nls_territory string AMERICA
nls_time_format string
nls_time_tz_format string
nls_timestamp_format string
nls_timestamp_tz_format string
SQL>
SQL>

Offense . None taken ...
I literally typed the sql ( as I did not copy & paste SQL / resultsets ) . I did use to_char in my original sql . I don't want to expose the real table . thats why I was giving the made up test case. If you carefully the SQL and the equivalent result sets ... you would have noticed .
Here is the SQL used ( of course , I have changed the table name ) ...
select to_char(startdate , 'mm/dd/yyyy') sdate, startdate from t
SDATE STARTDATE
09/18/2090 18-SEP-90 12.00.00.000000 AM
The flatfile had the value of 091890 as the data .

How often in the real time projects extract data from flat files n process

Similar Messages

Maybe you are looking for