Problem with flat file loading/Special characters
Hi, All,
We just migrated from Version 3.0B to BI7.0, and I've a problem which I can't handle for the moment. We are in Unicode, current codepage of the server is 4103 and codepage of frontend is 4110 (from SNL1 Transaction).
I'm loading czech texts in my material, via CSV files. The CSV file is correct on my PC, I see the special characters.
The problem is on my loading, whatever Character set I choose in the Infopackage (I choose Standard or Character Set Setting User-dependant), I cannot see the good characters.
Does any one of you already encounter this kind of problem, and, if yes, how did you solve it ?
Thanks
hi,
check out with your flat file letter's type, if it's in lower case letter's change them in
upper case letter's. or otherwise change the infobject's type as-- select check box
corresponding to lower case letter's in infoobject.
if helpful provide points
regards
harikrishna.N
Similar Messages
-
Issue with flat file loading timing out
Hello
I have a scenario, where I am loading a flat file with 65k records into a cube. The problem is, in the loading process, I have to look up the 0Material table which has a million records.
I do have an internal table in the program, where I select a subset of the Material table ie around 20k to 30k records. But my extraction process takes more than 1 1/2 hrs and is failing (timed out).
How can i address this issue? I tried building indexes on the Material table and its not helping.
Thanks,
Srinivas.Unfortunately, this is BW 3.5, so there is no END routine option here. And I tried both .csv and notepad file methods, and both are creating problems for us.
This is the total code, do you guyz see any potential issues:
Start Routine (main code)
refresh i_oldmats.
refresh ZI_MATL.
data: wa_datapak type transfer_structure.
loop at datapak into wa_datapak. (** I collect all the old material numbers from my flat file into an internal table i_oldmats**)
i_oldmats-/BIC/ZZOLDMATL = wa_datapak-/BIC/ZZOLDMATL.
collect i_oldmats.
endloop.
sort i_oldmats.
SELECT /BIC/ZZOLDMATL MATERIAL (** ZI_MATL only has recs. where old materials exist, this gets about 300k records out of 1M**)
FROM /BI0/PMATERIAL
INTO ZI_MATL FOR ALL
ENTRIES in i_oldmats WHERE
/BIC/ZZOLDMATL = i_oldmats-/BIC/ZZOLDMATL .
collect ZI_MATL.
Endselect.
Sort ZI_MATL.
Transfer rule routine (main code)
IF TRAN_STRUCTURE-MATERIAL = 'NA'.
READ TABLE ZI_MATL INTO ZW_MATL
WITH KEY /BIC/ZZOLDMATL = TRAN_STRUCTURE-/BIC/ZZOLDMATL
BINARY SEARCH.
IF SY-SUBRC = 0.
RESULT = ZW_MATL-MATERIAL.
ENDIF.
ELSE.
RESULT = TRAN_STRUCTURE-MATERIAL.
ENDIF.
Regards,
Srinivas. -
Problem with flat-file to oracle
Hi all,
Flat-file has 7 columns , all are varchar
SALE_2007
C1 VARCHAR2(255),
C2 VARCHAR2(255),
C3 VARCHAR2(255),
C4 VARCHAR2(255),
C5 VARCHAR2(255),
C6 VARCHAR2(255),
C7 VARCHAR2(255)
target also has 7 columns , first four column were varchar and the last 3 columns were numeric(20,2).
SALE
TIMECODE VARCHAR2(255),
CUSTCODE VARCHAR2(255),
SALECODE VARCHAR2(255),
PRODUCTCODE VARCHAR2(255),
AMOUNT NUMERIC(20,2),
COST NUMERIC(20,2),
SALEAMOUNT NUMERIC(20,2)
I have mapping the transformation on the staging with these function (ordering by order as above)
SALE_2007.C1
SALE_2007.C2
SALE_2007.C3
SALE_2007.C4
TO_NUMBER(REPLACE(SALE_2007.C5,',',''))
TO_NUMBER(REPLACE(SALE_2007.C6,',',''))
TO_NUMBER(REPLACE(SALE_2007.C7,',',''))
I have to use replace function because in the text file there is a comma in the data eg. 1,400.35
and the ODI will error in the step insert into flow table with error
+1722 : 42000 : java.sql.SQLException: ORA-01722: invalid number+
java.sql.SQLException: ORA-01722: invalid number*
Please advise
Thank you allHi-
It seems like there is non-numeric characters present in your C5-C7 columns. Please check your source data for these columns.
Thanks,
Saravanan Rajavel -
Hello,
I am trying to load data via flat file. we have entries in a field which starts with 0s are skipped when we load in CSV format.
like i have an entry 00657, is being loaded as 657 .
How can i prevent this?
Thanks.
PraveenHi Praveen,
It is of lenghth 5. but when i upload CSV file it is not considering 00 infront. But i want those. I am loading hierarchy from flatfile.
Suggest me, if we can also load from text ?.
Thanks.
Praveen -
Problem in flat file loading(bulk data)
Hi,
I am populating a flat file with 3lac records. I am getting error due to buffer space problem.
"Error during target file write "
around 2 lac records are getting inserted after that the above error is coming..
Now temporarily I am populating 1.5 lac and 1.5 lac in two times.
Could anyone please tell me how to solve this issue .
Thanks in Advance.I am using owb 10.2 version.
In the map source is a Oracle table, Target is a flat file.
Source table contains 3lac records.
I executed the map. During execution it is throwing the following error .
"Error during target file write "
But it has inserted 2lac records in the target file. -
Problem with applet file loading
I have a problem with loading files into a java applet. import java.applet.*;
import java.awt.*;
import java.io.*;
import java.util.*;
import java.net.*;
public class main extends Applet {
private static ArrayList<String> SGM;
public void init() {
SGM = new ArrayList<String>();
String gameDir = getParameter("game_dir");
try {
File fHandle = new File(gameDir+"game.sgm");
Scanner fScanner = new Scanner(fHandle);
while(fScanner.hasNextLine()) {
SGM.add(fScanner.nextLine());
//System.out.println(SGM.get(0));
} catch(Exception e) {
System.out.println("Applet threw error: "+e);
...The problem is with File fHandle = new File(gameDir+"game.sgm"); I tried putting File(gameDir+"/game.sgm"); and appending / to the folder in the <PARAM> tag, but it still changes it to \, which means I can only run it locally, and in Windows. Why is it doing this, and how can I fix it?This file you were hoping to load: it's on the server, right? Not on the computer where the applet is running in a browser?
(At least that's a common mistake made by people when they write their first applet.)
If that's the case then you can't use a File object to access a file on a different computer. To access a file on the server, first you will have to put the file in a place on the server where it can be downloaded. Then in your applet you need to get a URL for the file. (The getDocumentBase() method can be used to prevent you from having to hard-code the full URL for the file.) Next, "this.getClass().getResourceAsStream(URL)" gets you an InputStream from which you can read the data from the file. -
Problem with flat file upload with ASCII file
Hi All,
I am trying to load data into an ODS object via PSA using a text file (tab delimited). I have the following settings in my InfoPackage
External Data tab: ASCII File
Seperator for thousands:
Character for decimal point:
Currency Conversion:
Number of Header rows to be ignored: 1
Processing tab: Only PSA and Update into data targets subsequently
When I do a preview the data is not showing up in the right format....the tab seperation does not work and data is garbled with extra hexadecimal characters too.
The same file contents in .csv format is loading the data in the right format and preview is fine too.
I need help trying to convert this csv file to .txt format.
Any clues are highly appreciated
Thank youHi,
If in the infopackage you click on a File Type ASCII-file (CR delimiter) radiobutton and then F1, youll see the help:
With an ASCII file as a data source, the data has to be available as a string in the format of the transfer structure. There are no data separators, empty characters are not ignored.
This means that:
- you shouldnt use any delimiters among the record fields
- all fields should have the length the system expects (length of the appropriate infoobject in transfer structure)
- each record should be separated from the next by carriage return CR.
Since I think the program that converts file from Excel format into CR-delimited would be very useful, I created such program in VBA.
So, open your Excel file (if you have csv-file you can open it using Excel).
The program assumes that the first row of the file contain field names. Data itself begin from the 2nd row. Insert as the 1st and 2nd rows the new, blank rows.
Into A1 cell insert number of the last row with data, into B1 number of the last column. Certainly, it may be determined in the program, but I have not done it if someone wants it, s/he can try it.
Into fields of the 2nd row insert expected length of the field.
Make sure that Visual Bacis toolbar is seen. (If not tick in menu path: View/Toolbars/Visual Basic).
In this toolbar click on a Design Node icon.
Drag from the toolbar and drop into worksheet a Command button element.
Double click on the button. In the open window for Private Sub CommandButton1_Click() subroutine insert the following code:
Dim ws1 As Worksheet
Dim J As Long, I As Long, L As Long
Dim FileName As String, Out As String, formatOut As String
Dim LenCell As Long
Set ws1 = ThisWorkbook.Worksheets("SHEET1")
FileName = ThisWorkbook.Path & "\" & Left(ThisWorkbook.Name, Len(ThisWorkbook.Name) - 3) & "txt"
Open FileName For Output As #1
For J = 4 To ws1.Cells(1, 1)
Out = ""
For I = 1 To ws1.Cells(1, 2)
formatOut = (ws1.Cells(J, I))
L = Len(formatOut)
LenCell = Val(ws1.Cells(2, I))
If L > LenCell Then
formatOut = Left(formatOut, LenCell)
Else
Do While L < LenCell
formatOut = formatOut & " "
L = L + 1
Loop
End If
Out = Out & formatOut
Next
Print #1, Out
Next
Close #1
Set ws1 = Nothing
MsgBox "File transformation finished!", vbOKOnly
Now return to Excel sheet, click again Design Node icon switching into run mode.
When you press on this button now, the ASCII program will be created. It will have the same name as an input file (and in the same directory), but with TXT extention.
Remarks:
- The program works with the current worksheet named as SHEET1.
- Fields that are shorter than those expected by the system are padded by spaces from the right. It should not be the problem, since in transfer structure you can check symbols only flag.
- Longer fields are truncated to the length expected.
Best regards,
Eugene
Message was edited by: Eugene Khusainov -
Problem with jar file & loading manifest file
Hi Friends
i developing one application using java Swing
i deploying the whole application using the jar Utility.
but while installing & deploying this application on my machine & on the another machine error occured
which showing that failed to load manifestfile from main module Or Main class.
why this is happen? any other Java settings OR changing in java settings of the machine required while deploying this application on the other machine
please guide me.Show the contents of the manifest file,
and what command you used to run the program,
and what directory you ran the command from.
and what's the current classpath setting (if any). -
Hi Friends,
I am struggling with flat-file loading problem. I am trying to load a .csv file into data target. I took all pre-cautions while loading data. I look into preview and simulate the data. Everything is ok, but when i schedule the data, i found 0 records in the monitor. The following is the STATUS message of the above problem:
No data available
Diagnosis
The data request was a full update.
In this case, the corresponding table in the source system does not
contain any data.
System response
Info IDoc received with status 8.
Procedure
Check the data basis in the source system.
Can anybody help me what is the problem and procdure to resolve it?
Regards,
MaheshHi Eugene,
Thanks for the quick reply. The following screen-shot tells you the messages of detail tab;
OVER ALL STATUS MISSING WITH MESSAGES OR WARNINGS
REQUEST: MISSING MESSAGES
EXTRACTION
EVERYTHING IS OK
DATA REQUEST RECEIVED
NO DATA AVAILABLE DATA ELECTION ENDED.
PROCESSING
NO DATA
The above message was shown in details tab. Pls guide me to locate the problem.
Regards,
Mahesh -
Flat File loading Initialize with out Data transfer is disabled in BI 7.0
Hi experts,
When loading through flat file in BI 7.0 for Info Package Level Initialization Delta Process with data Transfer is coming by default,but when i want to select Initialization Delta Process without Data transfer is disabled. (in the creation of Data Source (flat file) in the Extraction Tab Delta Process is changed to FIL1 Delta Data (Delta Images).
please provide me Solution.
regards
Subba reddy.Hi Shubha,
For flat file load please go throught he following link:
http://help.sap.com/saphelp_nw70/helpdata/EN/43/03450525ee517be10000000a1553f6/frameset.htm
This will help.
Regards,
Mahesh -
Urgent: Flat file load issue
Hi Guru's,
Doing loading in data target ODS via flat file, problem is that flat files shows date field values correct of 8 characters but when we do preview it shows 7 characters and loading is not going through.
Anyone knows where the problem is why in the preview screen it shows 7 characters of date when flat file has 8 characters.
Thanks
MKHi Bhanu,
How do i check if conversion is specified or not and another thing is it is not just one field we have 6 date fields and all of them are showing 7 characters in PSA after loading where as flat file have 8 characters in all of the 6 date fields.
In PSA I checked the error message it shows 2 error messages:
First Error message:
The value '1# ' from field /BIC/ZACTDAYS is not convertible into the
DDIC data type QUAN of the InfoObject in data record 7 . The field
content could not be transferred into the communication structure
format.
em Response
The data to be loaded has a data error or field /BIC/ZACTDAYS in the
transfer structure is not mapped to a suitable InfoObject.
The conversion of the transfer structure to the communication structure
was terminated. The processing of data records with errors was continued
in accordance with the settings in error handling for the InfoPackage
(tab page: Update Parameters).
Check the data conformity of your data source in the source system.
On the 'Assignment IOBJ - Field' tab page in the transfer rules, check
the InfoObject-field assignment for transfer-structure field
/BIC/ZACTDAYS .
If the data was temporarily saved in the PSA, you can also check the
received data for consistency in the PSA.
If the data is available and is correct in the source system and in the
PSA, you can activate debugging in the transfer rules by using update
simulation on the Detail tab page in the monitor. This enables you to
perform an error analysis for the transfer rules. You need experience of
ABAP to do this.
2nd Error Message:
Diagnosis
The transfer program attempted to execute an invalid arithmetic
operation.
System Response
Processing was terminated, and indicated as incorrect. You can carry out
the update again any time you choose.
Procedure
1. Check that the data is accurate.
- In particular, check that the data types, and lengths of the
transferred data, agree with the definitions of the InfoSource,
and that fixed values and routines defined in the transfer rules
- The error may have arisen because you didn't specify the
existing headers.
2. If necessary, correct the data error and start processing again.
Thanks
MK -
Hi Experts,
I am loading data from Flat File to DSO.I got the following error while activating Data in DSO.
"No SID found for value ' 0500136A' of characteristic 0MAT_SALES"
I have checked in Material sales master data I have the value 0500136A in .If you see above error it showing some space in front of 0500136A.I am not seeing that space in master data.I was edidted again and loaded to DSO and activated Then I got same error.Is it problem with Excel File formatting related.Pls through some light onthe issue.
Thanks,
Suryam.Hi All,
Thank you.
Khaja,
I got the data upto PSA is fine and I am able to load the data in to DSO but I got the error while activating DSO
Ashok,
I loaded master data before loading Transactional data.May be it problem with file format.How can I check these format issues.
Brian,
We are using Transformation in BI7.0.I tried put conversion in DataSource level i.e Alpha for the field.But still I am getting same error.
Pls advice me on the above issue.
Thanks,
Suryam. -
How to built a hierarchy with flat file?
Hi Experts,
for a better representation of the report, i need to built a hierarchy with flat file.
The Data load is via Flat file.
Do you have some documentation about that?
Thanks
Cheers
GiloHi Gilo,
Check these docs...
<a href="https://www.sdn.sap.comhttp://www.sdn.sap.comhttp://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/0403a990-0201-0010-38b3-e1fc442848cb">How to Download a Hierarchy to a Flat File</a>
<a href="http://help.sap.com/saphelp_nw04/helpdata/en/fa/e92637c2cbf357e10000009b38f936/content.htm">Uploading Hierarchies from Flat Files</a>
<a href="http://sapbwneelam.blogspot.com">More Docs...</a>
Hope it Helps
Srini -
Transformation not generating-Flat file loading
Hello guys, I hope you can help me with this little confusion I have on BI7 Flat file loading.
I got a File (CSV) on my workstation. I am trying to load Master Data. Here is the example of my file and issues:
Lets say, I have CSV file named "CarModel.CSV" on my PC.
This excel file has 10 Records and No atributes for this Field.
So the records should show like this and it is showing correctly in PSA level, DS level.
A
B
C
D
E
F
My goal is to load Flat file data to InfoObject (inserted in Infoprovider)
I created Source system, DS, all thats stuffs.
I am now on Display DS screen under Proposal Tab. I am putting 10 Records to show and hitting Load example data....it works fine by showing all 10 records. However in the bottom part of this screen, what should show as a Field ?In my case , First it was showing the First Record ("A")...i didnt think it was correct but i prceeded anyways. Transformation could not be generated.
I tried by deleting "1" from the field "No. of header rows to be ignored" and its the same result ..No transformations.. I mean i know its very simple to load this data but i am not sure what i am doing wrong..My question is:
1) What should show under Field/propasal tab in my case?am i supposed to create this Field?
2) Should the system to propse the field which is from my flat file header ?in my case i dont have any header..should i have include header in my csv file like "car model"? i am confused please give me some info thanks
dkHi,
In filed tab, u have to enter ur infoobject names in an order...and press enter it'll automatically give the description and its other factors...
i guess u shuld have some header in the sense eg: customer,cust ID like this..this only u have to enter as fields...in proposal tab...try that
rgds, -
Flat File loading into Hierarchy
Dear Gurus,
I am trying to load a hierarchy from a flat file. I am not able to do it successfully.
I have a small doubt. Do we need to load the master data into the master data table before loading the hierarchy?
Explanation:
I have an info object zcountry and i had added zzone and zstate as external characteristics in hierarchy. the hierarchy structure should be country with 2 nodes zone1,zone2 and zone one should have 2 states under it as nodes. In this case do I need to maintain the master data in the infoobjects before loading the hierarchies with flat file.?
<b>Node ID InfoObject Node Name Link Parent ID Language Short-Txt Medium-Txt Long-Txt</b>
1; zcountry; CountryNode; 0; en; CountryNode; CountryNode; CountryNode;
2; zzone1; SouthZone; 1; en; SouthZoneNode; SouthZoneNode; SouthZoneNode;
3; zstate; AndhraPradesh; 2; en; AndhraPradesh; AndhraPradesh; AndhraPradesh;
4 zstate Karnataka 2 en Karnataka Karnataka Karnataka
5 zzone1 NorthZone 1 en NorthZoneNode NorthZoneNode NorthZoneNode
6 zstate Haryana 5 en Haryana Haryana Haryana
7 zstate Rajastan 5 en Rajastan Rajastan Rajastan
This is how the flat file looks like.
Kindly give me a solution.
Regards
Mohan Kumar.
Message was edited by:
mohan kumar
Message was edited by:
mohan kumarDear Gurus,
I also followed the same weblog but still i am not able to do that. That is the reason why I asked the question in that detail (with the data I am trying to load).
Regards
Mohan Kumar
Maybe you are looking for
-
Hai frnds , iam getting the eroor when i run autoconfig =========================[AutoConfig Error Report] The following report lists errors AutoConfig encountered during each phase of its execution. Errors are grouped by directory and phase. The rep
-
Yosemite crashes with Logitech bluetooth touchpad
Mac Mini late 2012 with OSX Yosemite crashes and reboots constantly when there is Logitech bluetooth touchpad connected. However if I turn touchpad power off after few hour use, everything keeps working fine. Keeping touchpad powered all the time cra
-
Hi all, I have an issue. I have created a customer say 'A' and a ship to party say 'B' and 'C'. In customer master of 'A', I have assigned ship to party 'B'. At the time of order creation for 'A', system shows me 'B' as possible option for ship to pa
-
I have been using Pagemaker 7 for a few years now. Three days ago for the first time i have problems. I cannot open any of the files, when I try and open the PM I get thsi message: "Cannot find PageMaker's resource file pm70.rsl" can any on
-
I have a decorative box and inside that I am showing a text. Now the decorative box is stretched to the entire width of the Screen, but I want it to stretch only as much as the text its containing. I have set the "dimensionsForm" property to "childre