Recordeset per message with variable recordset sequence?

Hi,
I'm uploading a text-file with three different recordset substructures in any number and in variable sequence. I.e. a file could look like below:
structure 1
structure 1
structure 3
structure 2
structure 1
structure 3
structure 1
Thus the File adapter settings are as follows:
Recordset Structure = structure 1,,structure 2,,structure 3.*
Recordset Sequence = Variable
This works fine, the problem is the file is huge and I would like to limit the number of records in each message by using the recordset per message parameter. But if you have a variable recordset sequence the whole message is regarded as one recordset. If I change to ascending sequence I get an unpredictable number of messages since a recordset change is only done every time the file "breaks the order" defined in the Recordset Structure. Basically I want each record to be regarded as a recordset so I can split the file up with a predictable number of record per message. Is there any work around possible?
//Johan

Dear Johan,
if we say structure 1 as "A" structure 2 as "B" structure 3 as "C" and with sequence as variable then "regular expressions" reprsented  as
(ABC).
any combination at file structure comes as a message or as you say single record at sender side.
if you really want to break the records and conquer where order is not important,
that is A record ,B record, C record are independent of each other at XI processing  then go for 3 FILE ADAPTERS and 3 different message structures as A*  2)B* 3)C*.
this will definitely result in controlling message load at XI .
but can say for sure that there can be no replacement for (ABC) since it results in various combinations of A,B,C for example take computer language set it is (10)* and your is (ABC) there by its very diffciult to break this structure equivalent to some structure which meets your requirement.
and also  no meaning of breaking it as (AB)* or any combination,
we will end no where if we look for replacement for (ABC),
what can we do is go for independent structures or limit Structure order at FILE mean
atleast (ABC)* or (ABC) .
Thanks & Regards,
Rama Krishna

Similar Messages

  • Error message with variable

    Is it possible to include a variable in message box?
    For example, i have a variable v_name and i want to include it in my error message.
    MESSAGE i001.

    Hi Enrique,
    Offcourse you can add your message in the message box only thing is you nedd to create a Message id with the below format.
    001      &  Not Found in the Database.
    in your statement you have to write:
    Message I001 v_variable.
    Then automatically the '&' will be replaced by V_Variable. and you will get the output as.
    989898 Not Found in the Database.
    Thanks,
    Chidanand

  • Recordsets per message - only works with RECORDSET

    I have previously got recordsets per message working when I use RECORDSET.  I now have a scenario that uses "row" instead of "RECORDSET".
    This is working for RECORDSET - it splits into a new message every 100 records........
    Recordset Name   RECORDSET
    Recordset Structure   RECORDSET,100
    Recordsets per Message   100
    ignoreRecordsetName   true
    RECORDSET.fieldNames   RECORDCODE,ACCOUNTID,CO..............
    RECORDSET.fieldFixedLengths   2,6,1,3,4,3,2,1,.............
    RECORDSET.lastFieldsOptional   yes
    When I change RECORDSET to be row - it only produces 1 message, even though 11,000 records
    Recordset Name   row
    Recordset Structure   row,950
    Recordsets per Message   950
    ignoreRecordsetName   true
    row.fieldNames   RECORDCODE,ACCOUNTID,CO..............
    row.fieldFixedLengths   2,6,1,3,4,3,2,1,.............
    row.lastFieldsOptional   yes
    Can anyone tell me what I am doing wrong?

    I can't believe there are no examples of these kinds of things because it is all about syntax most of the time in File Content Conversion and this can be so time consuming.  I got it to work eventually - hopefully this will save someone a couple of hours.  This worked:
    Recordset Name  row
    Recordset Structure row,1
    Recordsets per message 950
    ignoreRecordsetName true

  • Recordsets per Message not working

    I found that Recordsets per Message will split the source message into multiple messages and process them separately.  This will save my alot of time and is exactly what I need - but it does not work.
    I have in my sender file adapter the following parameters in File Content conversion:
    Document Name = MT_SND_ZADIG
    Document Namespace = urn://federalmogul.com/ADP/FINFRADP001/00
    Recordset Name = RECORDSET
    Recordset Structure = RECORDSET,*
    Recordset Sequence = Ascending
    Recordsets per Message = 10
    Key Field Type = String (case-sensitive)
    RECORDSET.fieldNames   RECORDCODE,ACCOUNTID,CONST_E,CONST_Z2M,MONTHYEAR,JOURNALCODE,FOLIOCODE,RECORDTYPE,DAY,GLACCOUNT,CODINGBLOCK,DEBITAMOUNT,CREDITAMOUNT,TEXT,FILLER1,FILLER2,ACCREF1,ACCREF3,EMPLOYEENO,REPORTTYPE,ZADIGCODE,ACC_TYPE,RESERVED,CENTURY
    RECORDSET.fieldFixedLengths  2,6,1,3,4,3,2,1,2,12,18,13,13,20,8,8,12,12,6,4,6,1,1,2
    RECORDSET.lastFieldsOptional   yes
    When I feed in a file with 77 records I would expect it to split it into 7 * 10 recordset and then 1 * 7 - why is it not doing this?

    Hi Lynn,
    And... what is the result you are getting?
    Try to change Recordset Structure with something different that Recorset name.
    Something like:
    Recordset Name = RECORDSET
    Recordset Structure = row,*
    row.fieldNames RECORDCODE,ACCOUNTID,CONST_E,CONST_Z2M,MONTHYEAR,JOURNALCODE,FOLIOCODE,RECORDTYPE,DAY,GLACCOUNT,CODINGBLOCK,DEBITAMOUNT,CREDITAMOUNT,TEXT,FILLER1,FILLER2,ACCREF1,ACCREF3,EMPLOYEENO,REPORTTYPE,ZADIGCODE,ACC_TYPE,RESERVED,CENTURY
    row.fieldFixedLengths 2,6,1,3,4,3,2,1,2,12,18,13,13,20,8,8,12,12,6,4,6,1,1,2
    row.lastFieldsOptional yes
    Follow the example is described in:
    http://help.sap.com/saphelp_nw04/helpdata/en/2c/181077dd7d6b4ea6a8029b20bf7e55/content.htm
    Regards,
    Carlos

  • RecordSets per message

    Hi
    Im doing a file to file scenario with content conversion. I have 10000 records in the file and i need to split the file using Recordsets per message option. I gave the value as 1000. In SXMB_MONI im getting 10 messages with proper payload. but in the target directory i can see 10 different files with only one (first) record in  it.
    Im using this configuration
    Recordset Name = (left this empty)
    Recordset Structure = RECORDSET,1
    specified parameter ignoreRecordsetName to true
    Did i miss anything

    My source and target structure are same
       <Record>  -- 0 to unbunded
          <Row>   -- 0 ro unbounded
                <Type/>
                <Org/>
                <Datel/>
           </Row>
           <Row> 
                <Type/>
                <Org/>
                <Datel/>
           </Row>
             10000 nodes
       </Record>
    Im using the following in the CC
    Recordset Name:Record
    Recordset structure:Row,1000
    Recordset per message:1
    This is working fine. I mean ini SXMB moni im getting correct structure as expected. But the all the files in the target directory have only first 1000 records.. what i see in moni is different from what the files have

  • Recordset per message not working

    Hi All,
    I got a scenario where i need to read a file of more than 1mb which has got around 6000 records.i want to read 100 records at a time and have mentioned
    "Recordset per message-100"
    in the file configuration.But still i am seeing a xml message of 6000 records in the XI.
    This is the configuration part for the file"
    Recordset Name:Record
    Recordset structure:Row1,*
    Recordset per message:100
    Row1.fieldNames:FirstName,LastName,MiddleName,City,Place,State,Country
    Row1.fieldSeparator:£
    Row1.processConfiguration:FromConfiguration
    Row1.endSeparator:'nl'
    the xml message i get now
    i need to process only 100 records at a time...
    Any Help greatly appreciated...
    Thanks,
    Aravind

    Hi,
    Can you please try this...
    Recordset Name:Record
    Recordset structure:Row1,*
    Recordset Sequence: Ascending
    Recordset per message:100
    But i assume you might get an xml like this...
    <MT>
    <Record>
    <Row1>
    </Row1>
    </Record>
    <Record>
    <Row1>
    </Row1>
    </Record>
    <Record>
    <Row1>
    </Row1>
    </Record>
    100 records...
    </MT>
    Thanks,
    Renjith

  • JMS Content Conversion - Need to control RecordSet per Message

    Hi All,
    I have done a simple JMS to JMS scenario with content conversion.
    I need to control  RecordSet per Message ( similarlly we do for the FILE . that is , Recordset Structure = Records, 500 and Recordset per message = 1)
    How to achive this in JMS adapter.
    Regards,
    B.Jude

    There doesnt seem to be an option for that in the messagetransforbean
    http://wiki.sdn.sap.com/wiki/display/XI/HowTo...ContentconversionmodulewithJ2EEJMS+adapter

  • Detecting message part after Recordsets per Message

    Hi !
    Scenario: File -> XI -> RFC
    Because of some big text files (about 30 or 40 mb) as input files, we need to use partition our files using Recordsets Per Message in the content conversion parameters of our file adapter (sender).
    We need to send to the RFC, the total number of messages that we are sending or at least, a flag to indicate that we are sending the LAST message.
    Example:
    one file has 21.000 records. We set the "recordsets per message" to 3000. Then XI will receive 7 messages with 3000 records each. When we call the RFC (receiver) after processing the 7th package, we need to send also a flag to indicate that that was the last message.
    Any ideas?
    Thanks !

    Hi Matias,
    There's a BPM pattern that deals with something like this. it's called BpmPatternCollectMessage and collects all messages of the same type until it gets a terminating message. so in your case you could define the terminating message as being the last / summary line of your input file (creating a new recordset type for that) and once you receive this message, which should be after the split up parts of your file, you could send out the RFC calls.
    Question is, how that will perform with large files.... probably not too well, although there have been some performance improvements to BPMs lately.
    Maybe you should try that as well and run a performance test against your solution with the Z Table. The problem with the Z table solution is, that you have to deal with the fact, that mappings can be executed more than once, in the case errors did occurr. so this can mean, that your function and hence the call to the Z table could occurr more than once for the same message. (remember mappings are stateless....)
    Regards
    Christine

  • Recordset per message for Header-Data-Trailer

    Hi Experts,
    I need to process a text file with the following structure:
    Header
      Record1
      Record2
      Record N
    Trailer
    How do i use Recordset per message to break the files into multiple files with EACH havign a Header and Trailer
    Thanks,
    Shobhit

    Hi Shobhit,
    I think it cannot be possible from File Content Conversion using Recordset per message.
    You should do that by means of multimapping 1:N
    Regards,
    Carlos

  • Recordset per Message and then group again

    Hi All,
        Advise would be aprreciated for the following issue we are having on a productive environment.
        The interface gets a 3.4MB file from a FTP server, performa a mapping and then saves a new file to the receiver ftp server.
        Sometimes, we get an error because the xml message that the AE sends to the IE does not contains all the information as the flat file. It seems that it runs out of resources and does not finish the xml transformation process.
         I have read several post in the SDN and even sap notes, about using the Recordset per Message option. However, this way I get a lot of IE messages but, also a lot of files in the FTP server and I only need 1. Is there any way I can split them to avoid this issue and then put them all together again? I don't like the "Append option".
         Thanks and kind regards,
             David Encinas.

    Hi David,
       Using split you can achive your requirement.
       First create the Structure as per your Source Format.
      If your structure has different Sub structure , create for each substructure at the target end.
      do the massage mapping in message tab source one message type , target multiple messages...do the same thing in Interface mapping .(Here select source and targets occurence 1 only)
      create the Integration Process (BPM)..once receive the message you can validate the message using Switch statement , once condtion has satisfied then use the Transformation step (1:n) and then message use many Send steps.
    You can create multiple files with same locations.
      I had done same thing for my req....
    Reagads,
    Venu.

  • Recordset per message in Sender File Adapter

    Hi Friends
    I have configured a sender file adapter to pick up *.txt files from a specific path, Since the file is having thousands of records it is failing to process the file at  PI level . In order to avoid the problem I have kept Recordset Set Per Message as 10 , but still PI is processing all the records into a single message. Please help me in troubleshooting it.
    Regards
    Suman.

    Hi Suman,
      Go thru these threads for troubleshooting...
    Massive file
    Processing huge file loads through XI
    Processing of huge no of Inbound xml files
    Bottleneck in Large file processing
    How to process large data files in XI  ?  100 MB files ?
    Regds,
    Pinangshuk.

  • File SENDER - "Recordsets per message" being ignored..

    Hi
    I have a file to file scenario
    Sender file:
    A1,A2,A3
    B1,B2,B3
    I want to split the SENDER/SOURCE file in the adapter (NO BPM) so that I am creating n number of RECEIVER files - ONE for each line.
    I am trying to use content conversions and setting "Recordsets per message" to 1 but it is completely ignoring this. and ONLY creating 1 file.
    I am NOT using any mapping and we are running PI 7.0
    Please help
    Cheers

    Hi
    As per my knwoledge you can split files at mapping level in integration engine but at adapter engine you are trying that is FCC which will just convert the data into XML.In FCC it will never split files, you have to do it at mapping level.
    Kindly check this link:
    http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/600b455f-01cd-2b10-0cab-a50e47a8f800?quicklink=index&overridelayout=true
    this is a step by process for your query.
    Regards,
    Nutan

  • "Recordsets per Message" for jdbc adapter

    Hi all,
    is "Recordsets per Message" kind of option is available for JDBC adapter.
    Any help will be appriciated
    Thanks
    -Kulwant

    Hi Kulwant,
    its not available.
    You can a stored procedure whick picks only certain number of records per each call.
    Regards
    Inder

  • Recordsets per Message in File adapter

    Hello All,
    I am  using Recordsets per Message option in Sender file adapter. And my source file contains more than the specified in Recordsets per Message.
    Can you please tell me why it is not working
    Regards,
    Moorthy

    Hi,
    Please try to make small addition in your Sender FCC.
    Recordset Structure: Row,5000
    Recordset per Message: 1
    It will divide your file into 5000 records and generate separate messages.
    Hope this helps to you.
    Regards,
    P.Rajesh

  • Recordset Per message

    Hi Group,
    I am using Record ser per message to split my large volume messages,but in my input I have one header,unbounded items,one tailor when I am using record set message it is splitting items and getting error in the MONI that Header target not able to generate,In the sender communication channel I am using content Conversion.
    Can any body suggest

    Hi,
    Can you give a try using this weblog:
    /people/stefan.grube/blog/2007/02/20/working-with-the-payloadzipbean-module-of-the-xi-adapter-framework
    Also see the question by Bhavesh in the end of the weblog.
    ---Satish

Maybe you are looking for

  • Populate a PDF with VBA and FDF, stopped working.

    I work with a non-profit children's camp where I need to be able to populate a PDF form from a MS Access database. The problem is that I do not have much server access, so I've had to find sneaky ways to do this. I can not use anything I have to inst

  • IO items

    How do i check all items/line items not cleared on internal order thanks Ganga

  • RAC Oracle 10.2.0.1 - Turning off software raid.

    Hello to everyone ! I have a RAC installed on Windows Server 2003 Oracle 10.2.0.1. with ASM option. I am running out of space and need to free some. My database is 230 GB but my storage space is about 500 GB. I have used all the space with my tablesp

  • Macbook pro recovery cd

    Hey, For the first time my macbook pro won't turn on. and like many other cases, is stuck on the openning screen with the spinning wheel. The problem is that, when i bought the macbook i didn't recived any cd with is...I haven't discoverd it until no

  • Custom Component vs. States

    Dear Catalyst team, After trying to work around the 15 states limitation by converting them into custom components. I ran into the problem that the pages of those custom components have the tendency to change their apearance relatively to the first p