ESB not moving data from database to flat file

Using ESB, created an database adapter/routing service (polling for changed records) & file adapter to write all records from a database table to a flat file as a series of XML entries in the file. I only get the last record from the database into the flat file. Using JDev 10.1.3.2 and SOA Suite 10.1.3. Have a 'status' column in the source database table that is set to 'PROCESSED' when the record has been processed. After I get the one XML element, representing the last record in the database, I look at the database table and ALL rows have their 'status' column set to PROCESSED - the field was null before the database table was processed.
How do I get ALL of the records into the flat file?
Thanks - Casey

Hi.
Check this:
ESB File Adapter: Append to log file not supported???
Denis

Similar Messages

Which CKM is used for moving data from Oracle to delimited file ?

Hi All
Please let me know Which CKM is used for moving data from Oracle to delimited file ?
Also is there need of defining each columns before hand in target datastore. Cant ODI take it from the oracle table itself ?

Addy,
A CKM is a Check KM which is used to validate data and log errors. It is not going to assist you in data movement. You will need an LKM SQL to File append as answered in another thread.
Assuming that you have a one to one mapping, to make things simpler you can duplicate the Oracle based model and create a file based model. This will take all the column definitions from the Oracle based model.
Alternatively, you can also use an ODI tool odiSQLUnload to dump the data to a file
HTH

How to extract data from Essbase to Flat File using ODI

Hi,
Anyone know how to extract data from Essbase to Flat File using ODI?
Thanks in advance.
Regards,
Sumardi

Hi,
Have you read through :-
Oracle Data Integrator Adapter for Hyperion Essbase Getting Started - http://download.oracle.com/docs/cd/E10530_01/doc/epm.931/odiess_getting_started.pdf
Oracle Data Integrator Adapter for Hyperion Essbase User's Guide - http://download.oracle.com/docs/cd/E10530_01/doc/epm.931/odiess_users.pdf
If you have read them and are still have a problem at what stage are you having the issues?
Cheers
John
http://john-goodwin.blogspot.com/

Issue to load data from database to XML file. error: ODI-40768

Hi,
While I am trying to load data from database to XML following error is appearing.
ODI-1228: Task TEST_XML_DATA (Integration) fails on the target XML connection MyLOCALXSD.
Caused By: java.sql.SQLException: ODI-40768: Could not save the file <default>:C:\DATA_FILE\www.xml because a class java.io.IOException occurred and said: The filename, directory name, or volume label syntax is incorrect
     at com.sunopsis.jdbc.driver.xml.SnpsXmlFile.writeToFile(SnpsXmlFile.java:751)
     at com.sunopsis.jdbc.driver.xml.SnpsXmlConnection.internalExecute(SnpsXmlConnection.java:769)
     at com.sunopsis.jdbc.driver.xml.SnpsXmlPreparedStatement.execute(SnpsXmlPreparedStatement.java:46)
     at oracle.odi.runtime.agent.execution.sql.SQLCommand.execute(SQLCommand.java:166)
     at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:102)
     at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:1)
     at oracle.odi.runtime.agent.execution.TaskExecutionHandler.handleTask(TaskExecutionHandler.java:50)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.processTask(SnpSessTaskSql.java:2906)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java:2609)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatAttachedTasks(SnpSessStep.java:540)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java:453)
     at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java:1740)
     at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$2.doAction(StartSessRequestProcessor.java:338)
     at oracle.odi.core.persistence.dwgobject.DwgObjectTemplate.execute(DwgObjectTemplate.java:214)
     at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.doProcessStartSessTask(StartSessRequestProcessor.java:272)
     at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.access$0(StartSessRequestProcessor.java:263)
     at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$StartSessTask.doExecute(StartSessRequestProcessor.java:822)
     at oracle.odi.runtime.agent.processor.task.AgentTask.execute(AgentTask.java:123)
     at oracle.odi.runtime.agent.support.DefaultAgentTaskExecutor$2.run(DefaultAgentTaskExecutor.java:83)
     at java.lang.Thread.run(Thread.java:662)
jdbc url: jdbc:snps:xml?d=C:\test_xsd.xsd&s=TESTSQL&re=employeesX&ro=true
physical schema: TESTSQL
Knowledge modules are:
LKM: LKM SQL to SQL
IKM: IKM XML Control Append
CKM: CKM SQL
Parameters set are:
CREATE_XML_FILE: true
XML_PATH:<default>:C:\DATA_FILE\www.xml
I have tried to change the directory path but error is still there.
Could some one please help me to resolve the issue?
Regards,
user1672911

Hi,
The trouble in "<default>:" - if you set XML_PATH as C:\DATA_FILE\www.xml instead <default>:C:\DATA_FILE\www.xml- it will work correctly.
Greetings,
Eugene

Error Loading data from oracle to flat file in oracle data integrator

Hi All,
I m trying to load data from oracle database to flat file.But I am getting the error at step "Insert new row"(integration)
Error Message is:
7000 : null : com.sunopsis.jdbc.driver.file.b.i
com.sunopsis.jdbc.driver.file.b.i
     at com.sunopsis.jdbc.driver.file.b.d.setDate(d.java)
     at com.sunopsis.sql.SnpsQuery.updateExecStatement(SnpsQuery.java)
     at com.sunopsis.sql.SnpsQuery.addBatch(SnpsQuery.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execCollOrders(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
     at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
     at com.sunopsis.dwg.cmd.e.i(e.java)
     at com.sunopsis.dwg.cmd.g.y(g.java)
     at com.sunopsis.dwg.cmd.e.run(e.java)
     at java.lang.Thread.run(Unknown Source)
I m nt able to find out the exact reason.Can anyone help me in that.

yes...I got the mistake which i was doing.Actually the target file data type should be string and I was defined it diffrent for each column.
When I chnged the data type to string,data get loaded to target table.
Thanks for your reply.

Problem with displaying the data from Database on swf file.

Hi ,
I am new to flash.Thanks in Advance Please help me....
Actually my requirement is my application consists a button(submit_Btn) when we click on the button(submit_Btn), each time it must to database(through servlet) and brings the data from database and places it on the flash swf file.Here my problem is for the first time when we click on the button it goes to database and place the data(which was returned from database) on the swf file.Next when we click on the button for the second time(or anytime) it is not going and bringing the new data from database(if some data is modified in database or not),Infact it is showing the old data(the data that was collected from previous ClickListener) only on the swf file and it is also not showing any complile time or run time error.
my Code looks like this:
submit_Btn.addEventListener(MouseEvent.CLICK,onCheck2);
function onCheck2(evnt:MouseEvent):void {
var xmlLoader:URLLoader = new URLLoader();
    var xmlurl:String = "http://localhost:8888/xmlServlet";
    var xmlrequest:URLRequest = new URLRequest(xmlurl);
xmlLoader.dataFormat = URLLoaderDataFormat.TEXT;
xmlLoader.addEventListener(Event.COMPLETE, xmlcompleteHandler);
xmlLoader.load(xmlrequest);
function xmlcompleteHandler(event:Event):void {
    var loader:URLLoader = URLLoader(event.target);
    var succData:String=loader.data;
        var xmlData:XML = new XML();
        var xmlList:XMLList;
        xmlData = XML(loader.data);
        xmlList = xmlData.children();
        for (var i=0; i<xmlList.length(); i++) {
            for (var n=0; n<xmlData.UserHumanap[i].HumanapDot.length(); n++) {
                    var x_coordinate:Number = xmlData.UserHumanap[i].HumanapDot[n].@x;
                    var y_coordinate:Number = xmlData.UserHumanap[i].HumanapDot[n].@y;
                    var point2:Point = new Point(x_coordinate,y_coordinate);
                    var circle:Sprite = new Sprite();
                    circle.graphics.beginFill(0x00ff00);
                    circle.graphics.drawCircle(point2.x,point2.y,3);   //Placing the data as dots on the swf file
Thanks in Advance.......Please Help me..........
its Urgent..........
Thanks,
Swarthi

Checkout following line in your code
var xmlurl:String = "http://localhost:8888/xmlServlet";
now change it to
var xmlurl:String = "http://localhost:8888/xmlServlet?random="+String(MAth.random());
I think you will get the point now

Can not get data from database

hi all,
    there is a problem , when i write like below :
SELECT * FROM bsis INTO CORRESPONDING FIELDS OF TABLE it_temp
          WHERE bukrs = p_bukrs
            AND hkont = p_hkont.
p_bukrs , p_hkont are all on the selection screen , and p_bukrs = 1200 another is eq blank. i can not find any data , but with the same condition i can find some data in database , when i debeg i found that p_hkont is initial.
    when i write like this :
SELECT * FROM bsis INTO CORRESPONDING FIELDS OF TABLE it_temp
          WHERE bukrs = p_bukrs .
this time i can find the data like the database.
    so , does someone know where the problem is , why i can not get data ?
kind regards
kevin

hi,
if u r using bukrs and hkont as parameters in selection screen then
SELECT * FROM bsis INTO CORRESPONDING FIELDS OF TABLE it_temp
WHERE bukrs = p_bukrs
AND hkont = p_hkont.
this will work.
if u r using then as select-option then the above does n't work.
bcoz select-options work as internal table bcoz of that u have use the query like this
SELECT * FROM bsis INTO CORRESPONDING FIELDS OF TABLE it_temp
WHERE bukrs IN p_bukrs
AND hkont IN p_hkont.
<REMOVED BY MODERATOR - REQUEST OR OFFER POINTS ARE FORBIDDEN>
Edited by: Alvaro Tejada Galindo on Aug 15, 2008 5:25 PM

Could not load data from database after adding a query

Dear all,
I have a working crystal reports 2011 report. This report get its data from a BW 7.01 system provided by three bex queries. Everything works as expected but not I have to add a fourth query to the report then I get the following messages:
I try to translate it because I user the german version:
INFORMATION: In this report a stored procedure is used. Ensure that no SQL expression was added and no grouping on server side will be done.
WARNING: Data could not be load from the database.
WANING: Invalid argument provided. Details: The key figure structure isn't a valid field for report generation. Use instead the real keyfigures with teir units.
Has anyone an idea what can be the reason for my issue?
Thanks and regards!

hi Gerrit,
a couple of questions...
1) are you adding all 3 queries (and then the 4th) in the same data connection or are each of these additional queries in a subreport?
2) if all 3 queries (and then the 4th) are in the same data connection are you linking them?
3) most importantly, if you create a brand new report off of the 4th query, is it successful?
it's been quite a while since I've worked with bex queries but in general adding multiple queries (or stored procs or commands or combinations thereof) to the same report is probably not a good idea. there ends up being a lot of processing happening in the crystal reports designer itself as a large virtual record set is created by the individual queries.
-jamie

SSIS to Export data from SQL to flat file dynamically

Hi.
I hope somebody can help me out, I have a table like this:
Date, StoreNumber, ProductCode, SalesItem, SalesAmout, Inventory
09-10-2014,10,1,10,10,30
As you can see I have a Date field and my table has information from 2014 at daily basis, What I'm trying to do is to export the information of this table to flat files, creating one file pear each date, as a result I will have about 280 files (one per date)
I do not know if it is possible or not.
Thank you.

Hi Mike,
you can do it using one Execute SQL Task and a ForEach Loop variable driven.
1st the Execute SQL Task "figures out" how many iterations the loop would need. The SQL as follows would drive it:
SELECT DISTINCT [DATE] FROM MyTable;
and you get the dates placed into a package variable of type recordset for the [280] files.
And then you can operate on the recordset in the loop "shredding it" in a DFT with a source query dynamically driven by the date as "select a,b,c from mytable where date = '" + @[User::CurentDate] + "'" placing each
"date" into its own file even naming the file after the date using the current value of the package variable (ADO row concept).
See an example: http://www.sqlis.com/sqlis/post/Shredding-a-Recordset.aspx
Arthur My Blog

How to export data from DB to flat file with ODI?

we want to export DB2 tables to flat files.
Who can tell me how to do it with ODI?
Please give me a simple example or steps.
Thank you.

There are two ways
Either use IKM Sql to File Append
(or)
OdiSqlUnload
For OdiSqlUnload you can use this technique to provide the connection parameters - http://odiexperts.com/?p=1985

How to download Data from Database directly into excel

I have a requirement to download very large quantity of data from database into Excel file.
But condition is excel file should have only 65,536 rows in a single spread sheet(that's the limit i suppose),if i have more data points(rows) than it should be stored into different spreadsheet.......this continues so there can be many spread sheets in a single excel file.
Data size can be 1 GB or more.
Also specific naming conventions need to be followed for giving name to excel as well as different spread sheets in it.
Please see if someone could help me out.

Thanks for ur reply,
But my requirement is to call "download to excel" method,in a java program on click by user for downloading an excel sheet on his machine.
This is be done as part of a web application which is to be made (so can't open the excel first)

DATABASE TO FLAT FILE

Hi every one !!pls help me i wanna transfer my data from table to flat file.i have even used a procedure but it throws an error for utl in init ora ,so tell me how to configure init ora and i am using
utl_file.file_type.
thanx to all

To use utl_file I believe you need to set up the init.ora with the name of the directory that you want to write to. See http://technet.oracle.com/doc/server.815/a68001/utl_file.htm#998101 for details.
You can also do it anoter way which is with SQL*Plus and just spool the file, for example:
SQL>spool emp.dat
SQL>select empno, ',', ename, ',' from scott.emp;
123,SMITH,
125,Jones,
SQL>Spool off;
This will wrtie a file named emp.dat to the directory which SQL*Plus is run from.

Data Could not be retrieved from database...

Hi All,
I have a problem on Excel 2007 while refreshing (for pivot table) data from SQL Server view:
"Data could not be retrieved from database. Check the database server or contact your database administrator. Make sure that external database is availiable, and then try the operation again"
Excel file is distributed on about 20 workstations in network with the same Excel version, and problem occurs only on one station. I have checked credentials and connection between workstation and server and it seems to be ok.
Any ideas?

it is problem, because sql server is not member of domain... so I'm using sql aunthentication.
strange thing is that from any other workstations (aldo in domain) it works fine when providing SQL user. I'm supposing that it is problem with some excel settings

Moving data from flat file

Hi,
I am moving data from flat file to oracle table. while populating the oracle table if I get any errors in flat file those errors should populate in ODI error table.
Is this is possible? if yes. Could you please let me know the set up in ODI.

CKM is the dedicated for checking the constraints while doing transformation. The constraints includes, PK,FK, conditions etc.,
There are two types/ways of checking the constraints.
Flow Control: Triggered CKM after data is loaded in to I$.
Static Control : Triggered CKM after data is loaded in to target table.
If you opt for any one the above ODI will create E$ and SNP_CHECK_TAB (summary table for logging the errors) and load the error records.
ODI will also provide you an option of loading the corrected error records by RECYCLE ERROR feature. In this phase/run ODI will load ONLY the error records in to target table (assuming its been corrected/cleaned).
**how to set up flow control could you please provide steps**
**Appreciate your help**

TRANSFER OF DATA FROM DATABASE TO APPLICATION SERVER

I have to upload /transfer data from database to application server .
I am not able to get it.
If anyone have any solution to it,
post it to me.
thanks

*& Report <name>
REPORT name.
DATA:
BEGIN OF FS_SPFLI,
CARRID TYPE SPFLI-CARRID,
CONNID TYPE SPFLI-CONNID,
COUNTRYFR TYPE SPFLI-COUNTRYFR,
CITYFROM TYPE SPFLI-CITYFROM,
AIRPFROM TYPE SPFLI-AIRPFROM,
COUNTRYTO TYPE SPFLI-COUNTRYTO,
CITYTO TYPE SPFLI-CITYTO,
AIRPTO TYPE SPFLI-AIRPTO,
FLTIME TYPE SPFLI-FLTIME,
DEPTIME TYPE SPFLI-DEPTIME,
ARRTIME TYPE SPFLI-ARRTIME,
DISTANCE TYPE SPFLI-DISTANCE,
DISTID TYPE SPFLI-DISTID,
FLTYPE TYPE SPFLI-FLTYPE,
PERIOD TYPE SPFLI-PERIOD,
END OF FS_SPFLI.
DATA:
T_SPFLI LIKE
STANDARD TABLE
OF FS_SPFLI.
DATA:
BEGIN OF FS_TABLE,
CHAR(100) TYPE C,
END OF FS_TABLE.
DATA:
T_TABLE LIKE
STANDARD TABLE
OF FS_TABLE.
DATA:
BEGIN OF FS_TABLE1,
CHAR(100) TYPE C,
END OF FS_TABLE1.
DATA:
T_TABLE1 LIKE
STANDARD TABLE
OF FS_TABLE1.
SELECT CARRID
CONNID
COUNTRYFR
CITYFROM
AIRPFROM
COUNTRYTO
CITYTO
AIRPTO
FLTIME
DEPTIME
ARRTIME
DISTANCE
DISTID
FLTYPE
PERIOD
FROM SPFLI
INTO TABLE T_SPFLI.
CALL FUNCTION 'GUI_DOWNLOAD'
EXPORTING
BIN_FILESIZE =
FILENAME = 'd:\files\p_spfli04'
FILETYPE = 'ASC'
APPEND = ' '
WRITE_FIELD_SEPARATOR = ' '
HEADER = '00'
TRUNC_TRAILING_BLANKS = ' '
WRITE_LF = 'X'
COL_SELECT = ' '
COL_SELECT_MASK = ' '
DAT_MODE = ' '
CONFIRM_OVERWRITE = ' '
NO_AUTH_CHECK = ' '
CODEPAGE = ' '
IGNORE_CERR = ABAP_TRUE
REPLACEMENT = '#'
WRITE_BOM = ' '
TRUNC_TRAILING_BLANKS_EOL = 'X'
WK1_N_FORMAT = ' '
WK1_N_SIZE = ' '
WK1_T_FORMAT = ' '
WK1_T_SIZE = ' '
IMPORTING
FILELENGTH =
TABLES
DATA_TAB = T_SPFLI
FIELDNAMES =
EXCEPTIONS
FILE_WRITE_ERROR = 1
NO_BATCH = 2
GUI_REFUSE_FILETRANSFER = 3
INVALID_TYPE = 4
NO_AUTHORITY = 5
UNKNOWN_ERROR = 6
HEADER_NOT_ALLOWED = 7
SEPARATOR_NOT_ALLOWED = 8
FILESIZE_NOT_ALLOWED = 9
HEADER_TOO_LONG = 10
DP_ERROR_CREATE = 11
DP_ERROR_SEND = 12
DP_ERROR_WRITE = 13
UNKNOWN_DP_ERROR = 14
ACCESS_DENIED = 15
DP_OUT_OF_MEMORY = 16
DISK_FULL = 17
DP_TIMEOUT = 18
FILE_NOT_FOUND = 19
DATAPROVIDER_EXCEPTION = 20
CONTROL_FLUSH_ERROR = 21
OTHERS = 22
IF SY-SUBRC <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
CALL FUNCTION 'GUI_UPLOAD'
EXPORTING
FILENAME = 'd:\files\p_spfli04'
FILETYPE = 'ASC'
HAS_FIELD_SEPARATOR = ' '
HEADER_LENGTH = 0
READ_BY_LINE = 'X'
DAT_MODE = ' '
CODEPAGE = ' '
IGNORE_CERR = ABAP_TRUE
REPLACEMENT = '#'
CHECK_BOM = ' '
VIRUS_SCAN_PROFILE =
IMPORTING
FILELENGTH =
HEADER =
TABLES
DATA_TAB = T_TABLE
EXCEPTIONS
FILE_OPEN_ERROR = 1
FILE_READ_ERROR = 2
NO_BATCH = 3
GUI_REFUSE_FILETRANSFER = 4
INVALID_TYPE = 5
NO_AUTHORITY = 6
UNKNOWN_ERROR = 7
BAD_DATA_FORMAT = 8
HEADER_NOT_ALLOWED = 9
SEPARATOR_NOT_ALLOWED = 10
HEADER_TOO_LONG = 11
UNKNOWN_DP_ERROR = 12
ACCESS_DENIED = 13
DP_OUT_OF_MEMORY = 14
DISK_FULL = 15
DP_TIMEOUT = 16
OTHERS = 17
IF SY-SUBRC <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
*LOOP AT T_TABLE INTO FS_TABLE.
WRITE:
/ FS_TABLE-CHAR.
*ENDLOOP.
OPEN DATASET 'p_spfli04' FOR INPUT IN TEXT MODE ENCODING DEFAULT.
IF SY-SUBRC EQ 0.
MESSAGE 'File Already Exists' TYPE 'I'.
STOP.
ELSE.
CLOSE DATASET 'p_spfli04'.
ENDIF.
OPEN DATASET 'P_SPFLI02' FOR OUTPUT IN TEXT MODE ENCODING DEFAULT.
LOOP AT T_TABLE INTO FS_TABLE.
TRANSFER FS_TABLE TO 'p_spfli04'.
ENDLOOP.
CLOSE DATASET 'p_spfli04'.
*ENDIF.
OPEN DATASET 'p_spfli04' FOR INPUT IN TEXT MODE ENCODING DEFAULT.
LOOP AT T_TABLE INTO FS_TABLE.
READ DATASET 'p_spfli04' INTO FS_TABLE.
APPEND FS_TABLE-CHAR TO T_TABLE1.
ENDLOOP.
Here is the sample code to download and upload the file onto presentation server and then using OPEN DATASET you'll be able to transfer the data to APPLICATION SERVER....
Regards,
Pavan P.

ESB not moving data from database to flat file

Similar Messages

Maybe you are looking for