Handling junk characters in XI

Hello,
I have developed a Inbound File-XI-SAP scenario .Where i have mapping failure in XI .I did my analysis and found that Business is sending us a file alogn with extra empty line as shown below
  ---> file should be limited to end of this line -->   ";,99100;,99100;241;172;41;"9788761920041       ";
> this is extra line which i believe is new line character .This is causing my mapping to fail --> 
So my question is how do we handle as i tried to write a batch program to handle this but in unix this BOX character as shown above is not there and file when read in unix is perfect.
Other way i tried is to open in different encoding but this is still showing up there .
So can we deal this using within XI ? If yes , plesae let me know .
Thanks for all help .

You can have java mapping program to get rid of the junk characters:
You can refer the following sample code to achive it:
public class FixEncoding implements StreamTransformation {
public void execute(InputStream in, OutputStream out)
throws StreamTransformationException {
String instr;
instr = parseIStreamToString(in);
instr = instr.replace( '&', '&' );
out.write(instr.getBytes());
then in your interface mapping, put the jave mapping in front of normal mapping program.
Regards.
Liang
Edited by: Liang Ji on Mar 12, 2009 4:36 PM

Similar Messages

  • How to Handle Junk Characters in BI Publisher Report?

    Hi Team,
    I have Created a column in obiee analytics report which has logic as '1/0'. After creating this column I am not getting result for this column(blank).
    When Extracted the report into XML file,I am not able to see value for that column as well. This is what I need too.
    But issue is, For my layout(below is sample example of my layout) It is not displaying the value as is in Analytics report in BIP Report. In Anlytics report I am getting Blank.In BIP it is giving the Junk Characters. Ex: SG&A row.
    I need to replace this Junk characters with space.This is my requirement.
    (p) Fuel
    0
    0
    0
    0
    0
    0
    0
    0
    0
    (q) Other Variable
    1,543
    1,325
    218
    4,123
    3,976
    147
    4,123
    3,976
    147
    Total Cost Of Goods Sold (Excl. S/L)
    28,944
    30,239
    -1,295
    87,252
    89,408
    -2,156
    87,252
    89,408
    -2,156
    (r) Straightline Expense
    1,679
    1,976
    -297
    4,501
    5,929
    -1,428
    4,501
    5,929
    -1,428
    Total Cost Of Goods Sold
    30,622
    32,215
    -1,593
    91,753
    95,337
    -3,584
    91,753
    95,337
    -3,584
    Gross Profit (Excl. S/L)
    -133,526
    -130,796
    -2,730
    -397,999
    -392,800
    -5,991
    -397,999
    -392,800
    -5,199
    SG&A









    (s) Payroll & Related
    4,515
    6,158
    -1,643
    14,910
    18,521
    -3,611
    14,910
    18,521
    -3,611
    here is the XML code for SG&A record:
    - <G_1> 
    <COLUMN0>MAR-2013</COLUMN0> 
    <COLUMN12>SG&A</COLUMN12> 
    </G_1>
      Can you please help me in achieving this.
      Thank You in Advance,
      KK.

    Hi,
    there's no direct support for the format triggers out of Oracle Reports. Therefore they are mentioned in the log file and in the created layout after conversion the objects with format triggers are colored red to show, that there you had to do some additional work.
    Currently you had to built the logic of format triggers in BI Publisher new. Hve a look in the User Guide, there are some examples for if or choose statements.
    regards
    Rainer

  • Junk Characters in file

    Hi Experts,
    I am using  GUI_DOWNLOAD to download a file on my local server, In debugging the file seems to be having perfect data but once the file gets
    downloaded it shows certain junk characters in the file.

    Hi Frederic,
    Thanks for the reply, I have seen the file in latest editor as well. It still shoes the junk characters.
    I am using the below mentioned code.
    {code}
    CALL FUNCTION 'GUI_DOWNLOAD'
             EXPORTING
    *     BIN_FILESIZE                    =
               FILENAME                        = FILE
               FILETYPE                        = 'ASC'
               APPEND                          = 'X'
    *     WRITE_FIELD_SEPARATOR           = ' '
    *     HEADER                          = '00'
    *     TRUNC_TRAILING_BLANKS           = ' '
    *     WRITE_LF                        = 'X'
    *     COL_SELECT                      = ' '
    *     COL_SELECT_MASK                 = ' '
    *     DAT_MODE                        = ' '
    *     CONFIRM_OVERWRITE               = ' '
    *     NO_AUTH_CHECK                   = ' '
               CODEPAGE                        = '4110'
    *     IGNORE_CERR                     = ABAP_TRUE
    *     REPLACEMENT                     = '#'
    *     WRITE_BOM                       = ' '
    *     TRUNC_TRAILING_BLANKS_EOL       = 'X'
    *     WK1_N_FORMAT                    = ' '
    *     WK1_N_SIZE                      = ' '
    *     WK1_T_FORMAT                    = ' '
    *     WK1_T_SIZE                      = ' '
    *     WRITE_LF_AFTER_LAST_LINE        = ABAP_TRUE
    *     SHOW_TRANSFER_STATUS            = ABAP_TRUE
    *     VIRUS_SCAN_PROFILE              = '/SCET/GUI_DOWNLOAD'
    *   IMPORTING
    *     FILELENGTH                      =
             TABLES
               DATA_TAB                        = IT_FINAL
    *     FIELDNAMES                      =
            EXCEPTIONS
              FILE_WRITE_ERROR                = 1
              NO_BATCH                        = 2
              GUI_REFUSE_FILETRANSFER         = 3
              INVALID_TYPE                    = 4
              NO_AUTHORITY                    = 5
              UNKNOWN_ERROR                   = 6
              HEADER_NOT_ALLOWED              = 7
              SEPARATOR_NOT_ALLOWED           = 8
              FILESIZE_NOT_ALLOWED            = 9
              HEADER_TOO_LONG                 = 10
              DP_ERROR_CREATE                 = 11
              DP_ERROR_SEND                   = 12
              DP_ERROR_WRITE                  = 13
              UNKNOWN_DP_ERROR                = 14
              ACCESS_DENIED                   = 15
              DP_OUT_OF_MEMORY                = 16
              DISK_FULL                       = 17
              DP_TIMEOUT                      = 18
              FILE_NOT_FOUND                  = 19
              DATAPROVIDER_EXCEPTION          = 20
              CONTROL_FLUSH_ERROR             = 21
              OTHERS                          = 22
         IF SY-SUBRC <> 0.
    * Implement suitable error handling here
         ENDIF.
    {code}

  • Junk Characters in HTML Post

    The application has notes field where user can type a few hundred chars of data. Some times users do copy from Word and paste into these notes field - This is posting some junk characters. Is there any way to take care of these extra characters? Some of the caharcters are needed to be carried and can't be discarded. Should I treat this as multi-part data? Along with Notes field, there are other fields too which carry regular data? In that case, does the form data type become multipart/mixed ? Are there any classes readily available that can handle mixed data?

    Depending on the file system and platform in use it may be necessary to rename the files on the OS level separately from the Oracle rename operation. To do that you can ususally use double quotes around the file name. It may be necessary to also escape a character if one of the characters is an OS meta-character like '$' in UNIX.
    If you set your command line editing to vi then ctrl-v can be used to insert a non-printable character inside you double quoted file name.
    HTH -- Mark D Powell --

  • Is there any other way to handle special characters other than using CDATA?

    I have xerces parser with which i am trying to parse data having special characters. Special characters also include other ascii characters. I tried using CDATA Section but still the problem persists.
    It would be really helpful if anyone can help me in solving this problem.
    Error encountered :
    org.xml.sax.SAXParseException: An invalid XML character (Unicode: 0xf) was found in the CDATA section.
    The XML which I use contains junk characters also . Have a look at the following:
    <?xml version='1.0' encoding='UTF-8' ?>
    <IMAGE_RESPONSE xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xsi:noNamespaceSchemaLocation='ImageResponse.xsd'>
    <IMG_TYPE>PNG</IMG_TYPE>
    <IMG_WIDTH>650</IMG_WIDTH>
    <IMG_HEIGHT>250</IMG_HEIGHT>
    <IMAGE_DATA>
    <IMGKEY>20020827:00000000:100000000010:02:</IMGKEY>
    <IMAGE_INFO>This is image info</IMAGE_INFO>
    <IMG_SOURCE>DCE_CIMS</IMG_SOURCE>
    <FRONT_IMG_FBW><![CDATA[�����&�J�Z�R��]]></FRONT_IMG_FBW>
    <FBW_ERROR>B</FBW_ERROR>
    <FRONT_IMG_FGS>C</FRONT_IMG_FGS>
    <FGS_ERROR>D</FGS_ERROR>
    <BACK_IMG_BBW>E</BACK_IMG_BBW>
    <BBW_ERROR>D</BBW_ERROR>
    <BACK_IMG_BGS>A</BACK_IMG_BGS>
    <BGS_ERROR>Unable to retrieve Back Gray-Scale image</BGS_ERROR>
    </IMAGE_DATA>
    </IMAGE_RESPONSE>

    java.net.URLEncoder.encode( text )
    I've found this to be a pretty easy way to handle invalid characters...

  • Report Pdf output getting Junk characters for some boiler Plate fields

    Hi All
    For Dunning Letter Report registered in Oracle Applications,made changes in Column headings like added customer number as Kunde for German Letter
    but in pdf output it's appearing as junk characters even date field is happening like that. It's happening for German, Spanish, Italy and French Letters. Working ok for Netherlands, English.
    any input to fix this solution will be great
    Thanks
    Kamalakar.G

    Maybe you check the NLS_LANGUAGE-settings on the client where you "edit" the reports-definition.

  • Time-dependent Vendor Master & Handling Special Characters

    Hi,
    I need to extract time-dependent Vendor Master.
    1. The data source for <b>0VENDOR</b> does not have fields to hold the valid date range.
    2. Does the Master data in R/3 for Vendors will hold the valid date range?
    3. The text for <b>0VENDOR</b> provides time-dependent, but how to map the <b>valid from</b> and <b>valid to</b> fields?
    Handling Special Characters:
    We are trying to extract data from Legacy system via DB Connect. The item text field consists of special characters. Of course in BW customization we can specify all the special characters to consider. But the special character we observed is 'square' symbol i.e. 'new line character' in Oracle. We are updating this to an ODS object. When looked at error log, observed that green light for the number of records transferred and updated, but finally when it load into ODS object and activates popping up the error message saying 'could not recognize special character'.
    Please help me getting the 2 issues resolved.
    Thanks in advance.
    Regards,
    Sudhakar.

    Hi Everyone,
    Thanks for inputs on Special characters issue...
    Finally resolved with below piece of code in the start routine:
    DATA: FLAG,
          OFF TYPE I,
          LEN TYPE I VALUE 1,
          ALLOWED_CHAR(95) VALUE
    '0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ`~!@#$%^&*()-_=+ ' &
    'abcdefghijklmnopqrstuvwxyz:;<>,.?/|\{}[]"'''.
    CONSTANTS: C_CHAR VALUE '-'.
      LOOP AT DATA_PACKAGE WHERE NOT /BIC/ZI_DESC IS INITIAL .
        DO.
          IF DATA_PACKAGE-/BIC/ZI_DESC CN  ALLOWED_CHAR.
            REPLACE SECTION OFFSET SY-FDPOS LENGTH LEN OF
                    DATA_PACKAGE-/BIC/ZI_DESC WITH C_CHAR.
            FLAG = SPACE.
          ELSE.
            FLAG = 'X'.
          ENDIF.
          IF FLAG = 'X'.
            EXIT.
          ENDIF.
        ENDDO.
        MODIFY DATA_PACKAGE.
      ENDLOOP.
    if abort is not equal zero, the update process will be canceled
      ABORT = 0.
    I have seen the link sent by 'Eugene Khusainov' today. Thought putting my piece of code that may help others...
    Regards,
    Sudhakar.

  • Oracle Report ouput is coming in english and junk characters

    Hi ,
    I am facing an issue with oracle report output in R12.
    The Report out is coming in english and junk characters.
    this report is custom report.
    Migrated from 11i to r12 instance.it is working fine in 11i with output as PDF.
    Sample out put is attached.

    Pl see if MOS Doc 1321874.1 is relevant

  • Junk characters like" � � "displayed in the jsp page please help.

    Hi,
    I am getting junk characters like � � displayed in the jsp page.
    In the JSP page i used javascript "& nbsp" for appending spaces to a string "CCR" to get "CCR " .
    Now the Resultant string "CCR " has three spaces appended to its right.
    This String is set in session in that JSP page.
    In the next JSP page i am getting that string from session.
    After getting the string the "substring" function is performed to get only the first 5 charcters of the string. Now the result is displayed as " CCR� � " with has last 2 characters as junk values � � insteed of displaying as "CCR ". Please help me in solving this issue.
    Please note that initially the sting "CCR" is got from the Oracle database in Solaris Machine.
    Regards,
    Vijay

    have you tried:
    strenuously inspecting the string that is coming from the db? do an actual loop over the string, character by character, dumping to System.out to make sure the characters are EXACT coming out of the db.
    note you have to append " " not just "& nbsp"
    post the code that is doing the output. the relevant bean code, the jsp, everything relevant - WITH COMMENTS discussing where things are happening.
    Also, is it "weird characters" in the browser only? have you done a view source on the actual html source that the browser is rendering (right click in IE and click view source). browsers can act odd if you don't feed then exactly what they want, and it looks like you're feeding it escaped characters that it is rendering as something else.

  • Junk characters in data transfer Program

    Hello ABAP gurus,
    i am facing the problem in an custmom made ABAP Interface program. the program has an option of downloading the files in local system(Windows system) and in Unix system (AL11). when i dwnload the files locally and feed that file to a CRM system, the CRM processes the file correctly but in case if we schedule a job then the CRM reads the file from Unix system and generates an error showing the junk characters for the special european characters. please request you guys to help me in this regard.

    Hi,
    When you download the file locally are able to see the junk character in the file.
    Logon on to the unix system and check the file content there and if any junk characters are there, usually when we upload the file then you will have those junk character being populated at the end of the record, open the file in unix and then remove those characters and reprocess that again, it will get through.
    Thanks,
    Mahesh.

  • Printer has been setup in one server but it's printing Junk characters

    Printer has been setup in one server but it's printing Junk characters
    Pdf file's sent from server and from local machine are printing fine..But prints sent from Oracle Reports are not getting printed, instead it is printing some garbage contents.

    Forgot to mention it's  10gAS (10.1.2.3) forms & reports

  • Preview Template shows junk characters

    Hi,
    I have uploaded my RTF in the Template Definition and clicked on Preview Template to view it.
    I see some junk characters coming in the PDF Preview output for the Euro symbol..If i run this as a concurrent program or run it locally in the system or preview it in format other than PDF everything else works fine..
    This issue is only when we preview the template from the Template Definitions, am having the issue of junk characters for Euro symbol.
    Any suggestions/helps pls?
    Regards,
    Genoo
    Edited by: Geno on Jan 17, 2012 11:19 AM

    Any help or suggestions please?
    Regards,
    Genoo

  • Report Output in text giving junk characters

    Hi All
    I have created custom report in rdf file format. When running the report set output as PDF means its come good. Incase i will change report output as text means its shows lot of junk characters in output time .
    How can i will solve the issue
    Sample Text Output :
    (s7BTAN CHONG MOTOR ASSEMBLIES S(s0B
    <-(s7BNo: 249, Jalan Segambut, 51200 Kuala <-(s0B
    <-(s7BSTATEMENT OF ACC(s0B
    <-(s7BAS ON(s0B (s7B16-APR-13<-(s0B
    <-(s7BSupplier (s0BAFM MART SDN BHD <-(s7BSupplier Account N<-(s0B
    NO 6 JALAN SS 4C/5
    TAMAN RASA SAYANG
    TAMAN RASA SAYANG
    PETALING JAYA
    PETALING JAYA
    SELANGOR
    Malaysia-47301
    03-78048099 Document Cur Base Curr
    Docume Curre --------- ---------------
    nt Ref Num Doc T Tranx Due D !CurRa Deb Cred Deb Cred Balan
    (s7BOpen I(s0B
    *****TESTINGABC STD INV ***********MYR 456 456 456
    *****TESTING123 STD INV ***********MYR 1000 1000 1000
    (s7BTotal Pa<-(s0B (s7B0(s0B (s7B1456(s0B (s7B1456(s0B
    (s7BTotal Outstandin(s0B (s7BCurrent(s0B (s7B31 - 60 Days(s0B (s7B61 - 90 Days(s0B (s7BAbove 90 D(s0B
    (s7B1456(s0B (s7B0(s0B (s7B0(s0B (s7B0(s0B (s7B0(s0B
    Edited by: 993525 on Apr 16, 2013 10:25 AM

    Hi
    What is your database/application characterset? - AL32UTF8
    NLS_LANG : AMERICAN_AMERICA.WE8ISO8859P1
    concurrent request log file
    -------------------+
    XXTC Custom: Version : UNKNOWN
    Copyright (c) 1979, 1999, Oracle Corporation. All rights reserved.
    XXTCM_SUPPLIER_SOA module: XXTC Supplier Statement
    Current system time is 16-APR-2013 10:40:18
    +-----------------------------
    | Starting concurrent program execution...
    +-----------------------------
    Arguments
    P_VENDOR_NUM_FROM='2'
    P_VENDOR_NUM_TO='2'
    P_INVOICE_DATE_TO='2013/04/16 00:00:00'
    APPLLCSP Environment Variable set to :
    Current NLS_LANG and NLS_NUMERIC_CHARACTERS Environment Variables are :
    AMERICAN_MALAYSIA.AL32UTF8
    Enter Password:
    Report Builder: Release 10.1.2.3.0 - Production on Tue Apr 16 10:40:19 2013
    Copyright (c) 1982, 2005, Oracle. All rights reserved.
    Start of log messages from FND_FILE
    End of log messages from FND_FILE
    Executing request completion options...
    Output file size:
    446
    ------------- 1) PRINT   -------------
    Printing output file.
    Request ID : 607096      
    Number of copies : 0      
    Printer : noprint
    Finished executing request completion options.
    Concurrent request completed successfully
    Current system time is 16-APR-2013 10:40:20
    Thanks Sanjay
    Edited by: 993525 on Apr 16, 2013 11:38 AM

  • Handling special characters in XML

    Hi,
    I am using Oracle 10g 'XMLType' datatype to store XML files. Before storing I parse the XML document using Java Xerces Parser. If it parses successfuly, then I perform some business rule execution based on XML file which was parsed. So till this stage there is no problems. But when XML file contains some special characters like copy-paste of some description from MS-Word document into XML tags, then Xerces parser will parse such characters with out any exceptions, but while inserting XML document, Oracle database just throws exception saying unable to handle special characters.. So how to avoid such exceptions or silent such exceptions with any specific settings respect to XMLType datatype in 10g DB.
    Please advice!
    Arvind Patil - IN

    Monica--
    In XI 2.0, we've noticed a number of issues processing special characters, primarily caused by the version of JCO that we're running.  It sounds like SAP has spent some time in the past few months focusing on these errors, so make sure you're on the most recent patchlevels of all your middleware components, including any of the middleware libraries that BC uses. In XI, we had to update the 3 files that make up the RFC library and JCO library.  SDM couldn't update the libraries for us -- we had to manually move the files to the right place.
    Escaped XML characters like "&amp;" "&#34;" "&quot;" were fixed as of JCO 2.0.10 (the current patchlevel on AIX/UNIX), the special character "&apos;" is fixed in the next release, JCO 2.0.11, due out in a few weeks (hotfixes are available).  I don't know the equivalent versions on other platforms.  By default, XI 2.0 appears to have shipped with JCO 2.0.5.  I would expect many XI 3.0 users to also be affected.
    This may or may not apply to BC, because I don't know what BC uses to talk to SAP under the covers.
    --Dan King
    Capgemini

  • Report displaying junk characters or Greek or some other language

    Hi All,
    I have one Custom report in PDF. It is a simple tabular report. When I run this report from Report Builder, it runs fine but when I register it in Oracle Apps and run it from there, it displays all the characters in Greek or some other language or junk characters. Sometimes it works if I change font. But its a trial and error. I dont understand why is it happening. This has happened with one of my other reports too. It worked when I changed the font and its size. This time it didnt work. Any clue how can I fix this issue?
    Any lead will be appreciated.
    Thanks,
    CAH
    Edited by: user638181 on Sep 3, 2009 7:05 AM

    Hi Hussein,
    We have similiar issue with our custom PDF reports. We are in the process of upgrading from 11.5.9 to R12.
    All these reports work fine in 11.5.9.
    Following are the details of our R12 environment:
    1) What is the application release? Application release is 12.1.1
    2) What is application/database characterset? Database - 11.1.0.7.0 and characterset is UTF8.
    3) Is this a text or bitmap report? What is the report language? - It is a text report and Language is English
    4) Do you use PASTA for printing? - Yes we do
    5) Do you get the correct printout if you print the concurrent request output file from the OS? - If I run the report from report builder directly, Yes. If from Oracle Apps, no.
    6) Expected output: "Days in Queue"
    Actual Output: when I copy and paste the output here it is showing correct. But on the report it is showing
    something like ∆Ωµ.....
    7) If I try changing the font, it works
    8) A different text field on the same report with the same font shows good.
    I would appreciate your help on this one.
    Thanks
    Vishnu

Maybe you are looking for

  • How to connect LG Ally to home wifi?

    I hit the icon to turn on wifi and it says it cannot turn on.  I don't know how to fix this.  Can anyone help?

  • LMS4.1 user tracking not sortable

    in LMS 4.1, under Monitor->Identity Dashboard, i have "user tracking summary" as a portlet, which tells me i have ~ 17,000 users.  when i click the report, it pops up a screen that shows mac address, ip address, hostname, subnet, etc. If i try to do

  • Several firefox problems

    is anyone being affected by these? 1. when it asks to save a password it asks twice everytime! 2. sometimes the direction keys inc. home end and sursor keys don't work - they don't as a i type 3. ctrl+t has stopped working?

  • How to use dual table in ODI in source side for nested queries?

    Hi, Any idea how to use dual table in source for more than once. I want to build a ODI interface for the following source query SELECT ACTV_TYP.ACTV_TYP_SRC_CD, ACTV_TYP.ACTV_TYP, PORT_ACTV_TYP.PORT_ACTV_TYP_SRC_CD, PORT_ACTV_TYP.PORT_ACTV_TYP, SFT_D

  • Lost my photos when i upgraded to 4.2 help????

    I'm new to this forum so excuse me if I ramble. I plugged my iphone into my mac computer last evening to back it up, update new apps and check for any software updates. When I have done this in the past, I have never had a problem with any lost data.