Format non-sap files to CSV
Hi,
I have this issue and would want your suggestions. we are pulling data from a non-sap system. We are using MS Access to retrieve the tables from the non-sap system. We then have to gro through and manually format the tables into attribute and text CSV files by pciking and choosing the table fields form the MS Access database. This is extremely tedious. What are other options for me to do this efficiently?
Thanks,
RT
Hi RT,
Yes you can load it via ETL. If it is a SAP certified ETL tool for e.g. Informatica then you can have a add-in in BW side known as SAP CONNECT and ETL can directly talk to your BW system via RFC. But if you don't have a SAP CONNECT in BW system then you need to interact via file interface. There will be definitely a high performance issues when you are interchanging big volume files between ETL and BW. Why don't you considering DB CONNECT ? Got feeling says that it would be much faster than ETL extraction.
If you are going for ETL interface then you might need to consider few design issues: -
1) How BW system should now when to extract the file or the file has reached the application server in BW ?
2) How to ensure that the file delivered by ETL is complete?
3) Data reconciliation may be required.
Hope it helps.
Thx,
Soumya
Similar Messages
-
Idoc inbound processing? from non-sap system?
Hi experts,
I'm confused with some functions below:
IDOC_INBOUND_SYNCHRONOUS
INBOUND_IDOC_PROCESS
IDOC_INBOUND_SINGLE
IDOC_INBOUND_ASYNCHRONOUS
can you tell me what are the differences? when to use them?
for sap outbound processing, we can only call function master_idoc_distribute to generate idoc or use message control to trigger outbound idoc. no other options, correct?
for sap inbound processing, if we use message control for automatical posting, we have process code which read the inbound idoc file and do the sap posting. when to use those functions above?
does the middlewares like seeburger, GIS call those functions to generate idocs at SAP side?
in what scenarios can we use those functions? read directly non-sap file into sap internal table then call the functions to create inbound idoc? how about the posting? call inbound processe code function after the functions above?
in case the interface between sap and legacy system is using above functions to build inbound idoc in sap and sap use process code for inbound posing, sap can monitor all inbound process using idoc, but how can the legacy system mornitor the interface?
Thanks.
Legend.
Edited by: legend li on Dec 21, 2010 4:58 PM
Edited by: legend li on Dec 21, 2010 5:40 PMHi Christophe,
Awesome!!!!!! it worked, You are the best.
I could able to create a sales order in CRM,but below are the valid data I passed in the respective segment fields.Except for first 3 values rest all did not get reflected in teh Sales order.I feel i am missing some qualifiers.
Can you kindly share the IDoc data to be passed in...along with respective segments and fields:
Segment Field
E101CRMXIF_BUSTRANS OBJECT_TASK
E101CRMXIF_BUSTRANS PROCESS_TYPE
E101CRMXIF_BUSTRANS POSTING_DATE
E101CRMXIF_PARTNER PARTNER_NO
E101CRMXIF_PARTNER RELATION_PARTNER_NO
E101CRMXIF_ORGMAN SALES_ORG
E101CRMXIF_ORGMAN DIS_CHANNEL
E101CRMXIF_ORGMAN DIVISION
E101CRMXIF_SALES PO_NUMBER_SOLD
E101CRMXIF_SALES YOUR_REF_SOLD
E101CRMXIF_SALES PO_NUMBER_SHIP
E101CRMXIF_BUSTRANS_ITEM ITEM_NUMBER
E101CRMXIF_BUSTRANS_ITEM ITEM_TYPE
E101CRMXIF_BUSTRANS_ITEM ORDERED_PRODUCT
E101CRMXIF_PRODUCT_I PROCESS_QTY_UNIT
E101CRMXIF_PRODUCT_I PROCESS_QTY_UNIT_ISO
E101CRMXIF_PRODUCT_I BASE_QTY_UNIT
E101CRMXIF_PRODUCT_I BASE_QTY_UNIT_ISO
E101CRMXIF_SCHEDLIN_I ORDER_QTY
Thanks a ton in advance .
Vijay -
Creating DataSources for File Source Systems in csv format in sap bw 7.0
Hi,
Please explain how to Create DataSources for File Source Systems in csv format in sap bw 7.0. WITH SCREENSHOTS
Thanks
JINI
Edited by: Jini Jayan on Jun 11, 2008 11:36 AMStep 1. Select Source systems under Modelling in the left panel. In the right panel, right-click Source systems and select Createu2026.
Step 2. Select the FileSystem, manual meta data, data using file inte option, and then click to continue.
Step 3. Enter a name and a description for the source system, and then click to create the source system.
Now create an application component
Step 1. Select InfoSources under Modelling in the left panel. In the right panel, right-click InfoSources and select Create application componentu2026.
Step 2. Enter a name and a description for the application component, and then click to continue. (BW automatically adds a prefix of "Z" to the technical names of application components, unlike the naming system used for other BW objects.If u give the name as AC_DEMO it will be saved as ZAC_DEMO in the system.
Now create infosource
Step 1.Select InfoSources under Modelling in the left panel. Right-click the newly created Application Component , and then select Create InfoSourceu2026.
Step 2. Select the option Master data/texts/hierarchies, and then click to continue.
Step 3. Enter your infoobject name, and then click to continue.
Now you will be asked
Infosource(name) assigned to Appln component(name)?
Click continue
Now go back to workbench and see the Infoobject listed under the Application component name (under Infosource)
Right click the infoobject name and select Assign Datasource
Enter the Infoobject name as Infosource name and the source system name and continue
Now you ll get datasource assignment confirmations for Infosource_ATTR and Infosource_TEXT for master data and text.
Click yes and continue
Now you ll be taken to the Infosource(master data) change screen
Source system name will be given
Below that u need to give the datasource name u2026.._ATTR
Click Activate.
Now Click the tab transfer rules
Copy the communication str infoobject names to an excel sheet
For ex if your infoobj are IO_MATNUM and IO_MATNAME (material number and material name) copy and paste as
IO_MATNUM IO_MATNAME
MAT001 TEA
MAT002 COFFEE
MAT003 SUGAR
GIVE YOUR DATA IN THE EXCEL. AND CLICK File Save As CSV(comma delimited) and save to ur system. Give file name as something like infosourcename_ATTR.csv
Now back to the Infosourcechange screen
Source system name will be given
Below that u need to give the datasource name u2026.._TEXT
And activate
Now Click the tab transfer rules
Copy the communication str infoobject names to an excel sheet
GIVE YOUR DATA IN THE EXCEL. AND CLICK File Save As CSV(comma delimited) and save to ur system. Give file name as something like infosourcename_TEXT.csv
Now create Infoobject to load data
Go to Infosourceu2014Appln Componentu2014InfoObju2014SourceSystemu2014rightclick->create Infopackage
Step 2. Select the DataSource Material number (Master data), enter a description for the InfoPackage, and then click to continue.
Give infopackage description as Infopackage:InfoObj_ATTR
Now take care to select the first item in datasource and click continue
In the next screen click external data tab
Click client workstation
Datafileu2026.file name (browse to give the file u saved in ur system)
There will be an option to remove header data from file.remove 1 row.
File typeu2014csv file
Now click schedule tabu2014start dataload immediatelyu2014start.
In the same way
Go to Infosourceu2014Appln Componentu2014InfoObju2014SourceSystemu2014rightclick->create Infopackage
Step 2. Select the DataSource Material number (text)enter a description for the InfoPackage, and then click to continue.
Give infopackage description as Infopackage:InfoObj_TEXT
Now take care to select the second item in datasource and click continue
In the next screen click external data tab
Click client workstation
Datafileu2026.file name (browse to give the file u saved in ur system)
There will be an option to remove header data from file.remove 1 row.
File typeu2014csv file
Now click schedule tabu2014start dataload immediatelyu2014start.
Click the icon below admn workbench to go to monitor and check the load
Or you go back to Infosourceu2014Appln Componentu2014InfoObju2014right clickmaintain master data
Click execute
You can see the data load
Hope this helps!!! -
How to add CSV file extension in output format of sap document in SCOT
Hello All,
i have added CSV in conversion rule through “SAP Customizing Implementation Guide–> SAPNetWeaver –>SAP Web Application Server -> Basis Services -> Communication Interfaces -> SAPconnect Client-Wide Settings -> General Settings -> Conversion Rules”. but it is not showing in SCOT (o/p format for SAP document).
Please do needfuli found this string on net
add a Conversion-rule (transaction SCOT like this:
CSV CSV 1 SX_OBJECT_CONVERT_TXT_INT
How i Add . -
Hi ,
I am new to sap.I have task like
Shipment history, customer orders, stock on hand, vendor purchase orders and some master data items for service parts are collected from SAP in a flat file format and imported into non sap on a monthly basis. A non-sap forecast is generated, as a text file output and imported back into the SAP.
For this task which method can I use.Do I need to use data set or sessions or ALE?
Please suggest me.
Thankshi Nithin,
Make use of ALE concepts for the same ...
here is the Link for the same..
http://edocs.bea.com/elink/adapter/r3/userhtm/ale.htm#1008419
Regards,
Santosh -
Downloading Excel File in CSV Format
Hi All,
How can I Download a file in .CSV Format?
I am using the below shown code.
CALL FUNCTION 'GUI_DOWNLOAD'
EXPORTING
BIN_FILESIZE =
FILENAME = 'C:\Documents and Settings\sandeepp3\Desktop\sample.csv'
FILETYPE = 'DAT'
APPEND = ' '
WRITE_FIELD_SEPARATOR = ','
HEADER = '00'
TRUNC_TRAILING_BLANKS = ' '
WRITE_LF = 'X'
COL_SELECT = ' '
COL_SELECT_MASK = ' '
DAT_MODE = ' '
CONFIRM_OVERWRITE = ' '
NO_AUTH_CHECK = ' '
CODEPAGE = ' '
IGNORE_CERR = ABAP_TRUE
REPLACEMENT = '#'
WRITE_BOM = ' '
TRUNC_TRAILING_BLANKS_EOL = 'X'
WK1_N_FORMAT = ' '
WK1_N_SIZE = ' '
WK1_T_FORMAT = ' '
WK1_T_SIZE = ' '
WRITE_LF_AFTER_LAST_LINE = ABAP_TRUE
SHOW_TRANSFER_STATUS = ABAP_TRUE
IMPORTING
FILELENGTH =
TABLES
DATA_TAB = ITAB
FIELDNAMES = HTAB
EXCEPTIONS
FILE_WRITE_ERROR = 1
NO_BATCH = 2
GUI_REFUSE_FILETRANSFER = 3
INVALID_TYPE = 4
NO_AUTHORITY = 5
UNKNOWN_ERROR = 6
HEADER_NOT_ALLOWED = 7
SEPARATOR_NOT_ALLOWED = 8
FILESIZE_NOT_ALLOWED = 9
HEADER_TOO_LONG = 10
DP_ERROR_CREATE = 11
DP_ERROR_SEND = 12
DP_ERROR_WRITE = 13
UNKNOWN_DP_ERROR = 14
ACCESS_DENIED = 15
DP_OUT_OF_MEMORY = 16
DISK_FULL = 17
DP_TIMEOUT = 18
FILE_NOT_FOUND = 19
DATAPROVIDER_EXCEPTION = 20
CONTROL_FLUSH_ERROR = 21
OTHERS = 22
IF SY-SUBRC <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
I am getting the field separator as Tab(SPACE).
Please AdviseHi Anil,
Try this way.
REPORT ztest_notepad.
"Declarations
TYPE-POOLS :truxs.
DATA : it_download TYPE truxs_t_text_data.
DATA: BEGIN OF it_data OCCURS 0,
arbgb TYPE t100-arbgb,
msgnr TYPE t100-msgnr,
text TYPE t100-text,
END OF it_data.
START-OF-SELECTION.
"Select Data
SELECT * FROM t100
INTO CORRESPONDING FIELDS OF TABLE it_data UP TO 200 ROWS WHERE sprsl = sy-langu.
"Convert SAP to CSV format
CALL FUNCTION 'SAP_CONVERT_TO_CSV_FORMAT'
EXPORTING
i_field_seperator = ';'
TABLES
i_tab_sap_data = it_data
CHANGING
i_tab_converted_data = it_download
EXCEPTIONS
conversion_failed = 1
OTHERS = 2.
IF sy-subrc = 0.
"Download data using GUI_DOWNLOAD
CALL FUNCTION 'GUI_DOWNLOAD'
EXPORTING
filename = 'C:\test.txt'
filetype = 'ASC'
TABLES
data_tab = it_download.
ENDIF.
Thanks
venkat.O -
Open Data Set Error while trying to read file from non SAP server
Hi all,
is it possible to read data from non-SAP application Sever?
I'm using OPEN DATASET p_filin FOR INPUT IN LEGACY TEXT MODE CODE PAGE '1504',
Where p_filin is other Windows server.Our applicition server is under Unix.Is it a problem?
I make test to read file from SAP application server and it was ok.So how to call other server?
Thanks!Hi,
Yes it is possible to read data from a non SAP server through the statement OPEN DATASET.
The important thing to check is that the SAP Server got enough access to the non SAP server so it can perform a reading/writing process depending on your needs.
You should contact your network administrator and BASIS to help you check the permissions. This can be pretty tricky, specially if the servers are in different domains.
Regards,
Gilberto Li -
Need help in writing data to a flat file in .csv format
Hi All,
could you please show with a sample example to write data in .csv format using UTL_file.
The result of the refcursor i want to write to a file in .csv format.
How can i achieve this.
ThxHi,
There are two ways to acheive this.
First and which I prefer is creating a SQL script which will generate csv file at the specified location in CSV format. And then this SQL script can be called from your cron job similar to how you call stored procedure. Following is pseudo code that can be used -
set linesize 500
set echo off
set feedback off
set prompt off
set pagesize 0
spool <name of the csv file>.csv
<Your select statement>;
spool offPut select statement delimiting columns you want to use with ','. E.g. following query should create a CSV file named as abc.csv with one record and 2 columns delimited by comma. First column is ENO and second column is ENAME.
set linesize 500
set echo off
set feedback off
set prompt off
set pagesize 0
spool abc.csv
select ENO || ',' || ENAME from employee;
spool offSecond, you can write a PLSQL procedure and then call this procedure from cron job. There is a generic procedure shared by BluShadow some time back which is a very good example for this. Please refer to following link for this solution -
REF Cursor creating CSV files
I will suggest to use first method above if possible since it will be faster and less complicated in my opinion. Second method is recommended for scenarios where select statement is created dynamically and cannot be written during development.
Hope this solves your purpose.
Cheers,
Anirudha -
Issue while downloading file in .CSV format
Hi,
I need to download the file in .CSV format.
I hade used FM SAP_CONVERT_TO_CSV_FORMAT and then used GUI_Download.
Now when I am opening file which is downloaded, it gives all the data in a single column. If there are 5 fields in my table, the generated file gives the data of all the 5 fields in a single column.
Could you please help?Hi try wi th the following code.
TYPE-POOLS : truxs.
DATA: t_file TYPE STANDARD TABLE OF type_file.
data:t_conv_data TYPE truxs_t_text_data.
CALL FUNCTION 'SAP_CONVERT_TO_TEX_FORMAT'
EXPORTING
i_field_seperator = ', '
TABLES
i_tab_sap_data = t_file
CHANGING
i_tab_converted_data = t_conv_data
EXCEPTIONS
conversion_failed = 1
OTHERS = 2.
CALL FUNCTION 'GUI_DOWNLOAD'
EXPORTING
filename = 'C:\TESTCSV.CSV'
filetype = 'ASC'
write_field_separator = ' '
TABLES
data_tab = t_file
fieldnames = names
EXCEPTIONS
file_write_error = 1
no_batch = 2
gui_refuse_filetransfer = 3
invalid_type = 4
no_authority = 5
unknown_error = 6
header_not_allowed = 7
separator_not_allowed = 8
filesize_not_allowed = 9
header_too_long = 10
dp_error_create = 11
dp_error_send = 12
dp_error_write = 13
unknown_dp_error = 14
access_denied = 15
dp_out_of_memory = 16
disk_full = 17
dp_timeout = 18
file_not_found = 19
dataprovider_exception = 20
control_flush_error = 21
OTHERS = 22. -
Idoc to file scenaro ( sending IDOC as it is to NON-SAP)
Hi Experts,
I am doing idoc to file scenario.
I am having SAP R/3 system with 3 clients(100, 200 & 300), IDOC is comming from SAP R/3( any one of the client)
In this is scenario, I am sending IDOC-XML as it is to the NON-SAP system.
I heard that, i can do in 3 ways. those are
1. Without any repository objects: you can go ahead with No interface mechanism on the target side.
2. Without message type: create a message interface whose message type would be idoc itself
3. With message type: export the IDOC as xsd file and re import the xsd file as an external definition.
If i go without IR objects,Please tell me whether i need to create Interface objects(i.e. DT,MT & MI) & Mapping objects (MM & IM) or not for the reciever.
MY ASSUPTION:
step1: I will import the IDOC into IR.
step2: Directly i will go to the ID without desiging any object in IR ( is it ok).
Is my assuption or correct or not?, please tell me.
So please tell me the entire scenario how to achieve this.
Please help in this issue.Hi Laxmi
1. Without any repository objects: you can go ahead with No interface mechanism on the target side.
-- Not Possible
2. Without message type: create a message interface whose message type would be idoc itself
-- No need for the Message Interface for IDOC. You will directly import the IDOC and do the Mapping
3. With message type: export the IDOC as xsd file and re import the xsd file as an external definition.
-- This is Possible. you are export the IDOC as XSD File and reimport the same. so there is no difference. If you are going to change the IDOC Structure then this is possible.
Here I am sending some links which are useful for IDOC to File Scenario. Please go thru the links given below..
While doing an IDOC -> XI -> File scenario, The Points to noted are:
1. You dont need a DT, MT or a message interface for the IDOC as it itself acts as the Message Interface.
2. You import the IDOC and use the same in your mapping.
3. In this configuration note that you dont have a sender agreement as you dont have a sender IDOC adapter.
If it is that you wanted to send an IDOC from XI (File to IDOC) , then in this case:
points 1 and 2 will remain, but the 3 will not. You will need a sender agreement for the file and a receiver agreement for the IDOC.
IDOC -> File scenario ref:
IDoc-XI-File scenario
File -> IDOC ref:
File to IDOC
To be able to trigger your IDOC from the SAP ISU system, you will have to set the partner profile in we20. Select your Business System (mostly under Logical system) and then create Outbound entries for whichever IDOC you want to trigger.
You define your basic type also in your partner profile settings, Please go thru the following links to get a better idea about partner profile:
http://help.sap.com/saphelp_nw04/helpdata/en/dc/6b833243d711d1893e0000e8323c4f/frameset.htm
http://help.sap.com/saphelp_nw04/helpdata/en/dc/6b7cd343d711d1893e0000e8323c4f/frameset.htm
http://help.sap.com/saphelp_nw04/helpdata/en/32/692037b1f10709e10000009b38f839/content.htm
http://help.sap.com/saphelp_nw04/helpdata/en/5e/b8f8bf356dc84096e4fedc2cd71426/frameset.htm
Also, I would suggest that you go through this blog by michal if any issue arises,
/people/michal.krawczyk2/blog/2005/03/29/xi-error--unable-to-convert-the-sender-service-to-an-ale-logical-system
/people/michal.krawczyk2/blog/2005/06/28/xipi-faq-frequently-asked-questions
I hope this answers your query.
Award the POINTS if it is useful **
Cheers
Vasu -
Converting flat files to csv format
hi,
Iam converting flat files to csv format..the problem is that iam running a script for inserting values.while i run this script it works fine .but while i open this csv file the datas in the excel sheet is not coming in a single line that is for a particular record its moving to second line .there is a break for a single record.so there is a problem in conversion.can anything be done in it this to avoid the breaking of lines
thanks
RatheeshYOGenereally, you shouldn't convert from a lossy format AAC or MP3) to another lossy fomrat.
It's called loss because you lose information when you convert it.
If you only use these files on the computer and the iPod, I'd recommend AAC. Better quality at same bit rate as MP3. -
Saving the output of a .sql file in .csv format
Hi,
I am saving the output of a .sql file in .csv format. But the problem is , the record of few columns have "new line" character in it, so when it is getting saved in .csv format, those records are coming in multiple rows, but they should come in one single row in single block. Please advise how to overcome this problem.
Regards,
NirajHi Guys,
I guess, there is a misunderstanding.
He is talking about the issue caused as a result of the data containing a "CRLF" ( Carriage return Line feed ) .
That is mainly a data issue.
The query i presume, must be right.
I guess you should be able to fix it using some string functions.
Some thing similar to this
CREATE TABLE ASH (NAME VARCHAR2(10))
SELECT REPLACE(NAME, CHR(13)||CHR(10), 'ISH') FROM ASH;
SELECT REPLACE(NAME, CHR(10), 'ISH') FROM ASH;
SELECT REPLACE(NAME, CHR(13), 'ISH') FROM ASH;
depending on the type of new line whether it is CR or LF. or CRLF.
Regards
Ashish/- -
Need instructions for downloading a CD in non-compressed file format
Friends, I have purchased some woo-woo brain wave meditation CD that requires it be downloaded to my ipod in a non-compressed file format -- either .wav or aiff. I have absolutely no idea what that means or how to do it. HELP!!
Change your import settings to AIFF or WAV and import the CD. Go to Edit>Preferences>Advanced>Importing and from the "import using" menu choose AIFF encoder or WAV encoder: How To Choose Import Settings
-
DME output files in CSV format
Hi,
Can anybody please let me know whether we can get the DME output files in CSV format using program RFFOJP_L?
Your help and time will be really appreciate.
Thanks & Regards,
Niki Shah
Edited by: Niki Shah on Aug 5, 2009 10:14 AMNo it will not work. You need full Photoshop (CS5)
-
File Transfer from non-SAP System.
Hi Experts,
We have the requirement to copy/transfer file from non-SAP system to SAP system file server. Can we use these FMs FTP_CONNECT, FTP_COMMAND and FTP_DISCONNECT?
or can we also use SXPG_COMMAND_EXECUTE?
Thanks,
EdsonHi Varma,
Thanks. I'm looking at the FTP_COMMAND FM. If I got it right the 'command' parameter here should be the OS level commands? Example would be cp <file path from source> <file folder of destination> for unix. ?
Thanks again,
Edson
Maybe you are looking for
-
Can't get OPP service started after OATM due to can't open file for reading
This is my second run on the OATM upgrade. OPP (and thus XML reports) came up fine after the 2nd run. After this run, had some issues with enqueing and solved them in an S/R with Oracle, but now I can't start OPP. I have tried all sorts of things, li
-
Can I share my iTunes content with my kids new iPod touch ?
Can I share my iTunes content with my kids new iPod touch ?
-
I appreciate that this functionality is only offered to those who have made a significant contribution to the discussion forums already, but how about at least a mail link for the rest of us? Ever since iTunes 7 shipped, I've come across reams of mor
-
Why does content.setLayout() generate runtime error?
Hi all. Can some guru please explain to me why this code is generating following runtime error: java.lang.Error: Do not use SampleView.setLayout() use SampleView.getContentPane().setLayout() instead at javax.swing.JApplet.createRootPaneException
-
Cannot ssh, Permission Denied
Very odd. Cannot SSH into a Mac Pro (10.6.7) on my network Can ping the box at it's IP Also cannot see this Mac in ARD I have Remote Login and Remote Management enabled for All Users I thought it may be "Firewall" being on (which in the past will blo