Large Inbound file

The B2B fails to handle large size inbound documents. The SOA composite in EM console shows running status and waits for XML file from B2B.
This happens whenever inbound x12 files size is greater than 3MB. The B2B converts X12 FILE to xml format of approx 9 MB size.
We are using default connectivity between B2B and SOA composite ( b2B adapter). With this big xml file either b2B adapter fails in receiving huge file or sometimes even transport channel in B2B gets HUNG UP. We need to bounce the server to clean up all processes.
Is there some way to process huge files in b2B. Can we split the incoming file and create multiple small files( looks not possible as file has only one transaction).
Can we write somekind of business rule in document definition to skip some elements from file based on rule and to only include elements value in final xml if rule condition is satisfied.
Vijay.

Vijay,
default (fabric) binding is not recommended for large payload processing. Please use JMS mode of B2B adapter instead. Please refer -
http://docs.oracle.com/cd/E17904_01/integration.1111/e10229/app_perform.htm#BABEHDIA
Regards,
Anuj

Similar Messages

Arbitrary waveform generation from large text file

Hello,
I'm trying to use a PXI 6733 card hooked up to a BNC 2110 in a PXI 1031-DC chassis to output arbitrary waveforms at a sample rate of 100kS/s. The types of waveforms I want to generate are generally going to be sine waves of frequencies less than 10 kHz, but they need to be very high quality signals, hence the high sample rate. Eventually, we would like to go up to as high as 200 kS/s, but for right now we just want to get it to work at the lower rate.
Someone in the department has already created for me large text files > 1GB with (9) columns of numbers representing the output voltages for the channels(there will be 6 channels outputting sine waves, 3 other channels with a periodic DC voltage. The reason for the large file is that we want a continuous signal for around 30 minutes to allow for equipment testing and configuration while the signals are being generated.
I'm supposed to use this file to generate the output voltages on the 6733 card, but I keep getting numerous errors and I've been unable to get something that works. The code, as written, currently generates an error code 200290 immediately after the buffered data is output from the card. Nothing ever seems to get enqued or dequed, and although I've read the Labview help on buffers, I'm still very confused about their operation so I'm not even sure if the buffer is working properly. I was hoping some of you could look at my code, and give me some suggestions(or sample code too!) for the best way to achieve this goal.
Thanks a lot,
Chris(new Labview user)

Chris:
For context, I've pasted in the "explain error" output from LabVIEW to refer to while we work on this. More after the code...
Error -200290 occurred at an unidentified location
Possible reason(s):
The generation has stopped to prevent the regeneration of old samples. Your application was unable to write samples to the background buffer fast enough to prevent old samples from being regenerated.
To avoid this error, you can do any of the following:
1. Increase the size of the background buffer by configuring the buffer.
2. Increase the number of samples you write each time you invoke a write operation.
3. Write samples more often.
4. Reduce the sample rate.
5. Change the data transfer mechanism from interrupts to DMA if your device supports DMA.
6. Reduce the number of applications your computer is executing concurrently.
In addition, if you do not need to write every sample that is generated, you can configure the regeneration mode to allow regeneration, and then use the Position and Offset attributes to write the desired samples.
By default, the analog output on the device does what is called regeneration. Basically, if we're outputting a repeating waveform, we can simply fill the buffer once and the DAQ device will reuse the samples, reducing load on the system. What appears to be happening is that the VI can't read samples out from the file fast enough to keep up with the DAQ card. The DAQ card is set to NOT allow regeneration, so once it empties the buffer, it stops the task since there aren't any new samples available yet.
If we go through the options, we have a few things we can try:
1. Increase background buffer size.
I don't think this is the best option. Our issue is with filling the buffer, and this requires more advanced configuration.
2. Increase the number of samples written.
This may be a better option. If we increase how many samples we commit to the buffer, we can increase the minimum time between writes in the consumer loop.
3. Write samples more often.
This probably isn't as feasible. If anything, you should probably have a short "Wait" function in the consumer loop where the DAQmx write is occurring, just to regulate loop timing and give the CPU some breathing space.
4. Reduce the sample rate.
Definitely not a feasible option for your application, so we'll just skip that one.
5. Use DMA instead of interrupts.
I'm 99.99999999% sure you're already using DMA, so we'll skip this one also.
6. Reduce the number of concurrent apps on the PC.
This is to make sure that the CPU time required to maintain good loop rates isn't being taken by, say, an antivirus scanner or something. Generally, if you don't have anything major running other than LabVIEW, you should be fine.
I think our best bet is to increase the "Samples to Write" quantity (to increase the minimum loop period), and possibly to delay the DAQmx Start Task and consumer loop until the producer loop has had a chance to build the queue up a little. That should reduce the chance that the DAQmx task will empty the system buffer and ensure that we can prime the queue with a large quantity of samples. The consumer loop will wait for elements to become available in the queue, so I have a feeling that the file read may be what is slowing the program down. Once the queue empties, we'll see the DAQmx error surface again. The only real solution is to load the file to memory farther ahead of time.
Hope that helps!
Caleb Harris
National Instruments | Mechanical Engineer | http://www.ni.com/support

Problems viewing large tif files in preview

i'm having trouble viewing large tif files in preview. the tif files are on a cdrom - when i click on the file to open it, it opens only the first 250 pages of the file. the file has approximately 3,000 pages. how can i get preview to open the rest of the pages?
thanks for any suggestions.
mac mini Mac OS X (10.4.6)

no trick - i didn't create the cdrom but it only has 3 tif files with approximately 3000 pages each, not 3000 large tif files. plus several smaller pdf files, but those aren't giving me any problems.
i don't know whether they're compressed, but i still can't get more than the first 250 pages to open, even after copying the file to my desktop. if anyone has any other ideas, i'd much appreciate it.
mac mini Mac OS X (10.4.6)

How can I send a large video file from my iPhone 4?

How can I send (by text) a (fairly) large video file from my iPhone 4 without it getting compressed first?
If that's not possible is there a way to uncompress the video file one it is received onto the receiving iPhone?
Or is there a way to sync or transfer a video file from iPhone to iPhone?

ExFAT would be the best file system format, as it will handle files greater than 4GB.
If exFAT is not available, go for FAT32.
Just FAT is too limiting, so avoid that

Error in generating a new XSL Transformer from large xslt File

Good day to all,
Currently I am facing a problem that whenever i try generating a Transformer object from TransformerFactory, I will have a TransformerConfigurationException threw. I have did some research from the net and understand that it is due to a bug that JVM memory limit of 64kb. However is there any external package or project that has already addressed to this problem? I have checked apache but they already patch the problem in Xalan 2.7.1. However I couldn't find any release of 2.7.1
Please help
Regards
RollinMao

If you have the transformation rules in a separate XSLT file, then, you can use com.icl.saxon package to get XML files transformed. I have used this package with large XSL files and has worked well.

Is there a way to import large XML files into HANA efficiently are their any data services provided to do this?

1. Is there a way to import large XML files into HANA efficiently?
2. Will it process it node by node or the entire file at a time?
3. Are there any data services provided to do this?
This for a project use case i also have an requirement to process bulk XML files, suggest me to accomplish this task

Hi Patrick,
I am addressing the similar issue. "Getting data from huge XMLs into Hana."
Using Odata services can we handle huge data (i.e create schema/load into Hana) On-the-fly ?
In my scenario,
I get a folder of different complex XML files which are to be loaded into Hana database.
Then I gotta transform & cleanse the data.
Can I use oData services to transform and cleanse the data ?
If so, how can I create oData services dynamically ?
Any help is highly appreciated.
Thank you.
Regards,
Alekhya

Inbound Files Create Sales Order With Reference To Quotation

Dear All,
I am working one Assignments For Sales Order Creation Through Inbound Files and Its working fine.
But I have one Issue during creation of Sales Order through inbound files ( Which Contains Quotation Number Which Already Exist in SAP ) and Quotation Number updated in PO Number (BSTKD) filed in Sales Order.
And My Problem is How we can update Quotation in Document Flow during creation of Sales Order through inbound files..
Any Help or Suggestion will very helpful for me.
Thanx in Advance.
Regards
Vijay Maurya

Dear All,
I am working one Assignments For Sales Order Creation Through Inbound Files and Its working fine.
But I have one Issue during creation of Sales Order through inbound files ( Which Contains Quotation Number Which Already Exist in SAP ) and Quotation Number updated in PO Number (BSTKD) filed in Sales Order.
And My Problem is How we can update Quotation in Document Flow during creation of Sales Order through inbound files..
Any Help or Suggestion will very helpful for me.
Thanx in Advance.
Regards
Vijay Maurya

Copying large video files to PC-external HD

I need to deliver a large Quicktime-file (5,87 Gb) edited in FCE to someone who will open it on his PC in Avid.
It seems to be complicated:
First problem is conversion - I need to convert my QT-file to a Windows Media file, right?
This can be done with a conversion programme, i.e. Microsoft Expression Encoder that I have installed on a PC laptop.
But how to move the 5,87 Gb file to the PC?
I have an external HD formatted FAT32, but that only takes files up to 4Gb max.
Is there really no way to copy a large mov.file on to an external hard drive that can be read by a PC?
Tog o around the problem, I have tried to make an avi.file by exporting from FCE with Quicktime conversion - but the quality is really bad.
Also making a smaller QT-file (that does not exceed 4 Gb limit on the HD) does not look good when compressed a second time in Expression to a Windows Media file.
So, what to do?
Can PC's read NFTS-formatted HD?? I guess not, I tried onc,e but maybe I didn't format it right.
Sorry for all these questions in one go - hopefully there's a way to work around this annoying problem...

For file transfer, here's what I suggest (sort of in order of recommendation):
Use a network connection. Both computers (your Mac & your friend's pc) on the same network; turn on file sharing on your Mac, log the pc on to your Mac and copy the file(s).
Use an FTP connection via the internet. You and your friend will both need an FTP client.
Use an NTFS formatted external hard drive. All modern pcs use NTFS (Windows 2000/XP/Vista/7). You will need a copy of NTFS for Mac (or similar utility) on your Mac to write to an NTFS formatted disk.
Use a Mac OS Extended formatted external hard drive. Your friend will need a copy of MacDrive (or similar utility) on his pc to read files from a Mac OS Extended formatted disk.
Burn your 5.87GB file to a dual-layer DVD disk. Use the Finder to copy the file to DVD media & burn the disk. Your Mac will need to be able to burn to dual-layer DVD media; and your friend's pc will need to have a DVD drive to read the disk.

Large Data file problem in Oracle 8.1.7 and RedHat 6.2EE

I've installed the RedHat 6.2EE (Enterprise
Edition Optimized for Oracle8i) and Oracle
EE 8.1.7. I am able to create very large file
( > 2GB) using standard commands, such as
'cat', 'dd', .... However, when I create a
large data file in Oracle, I get the
following error messages:
create tablespace ts datafile '/data/u1/db1/data1.dbf' size 10000M autoextend off
extent management local autoallocate;
create tablespace ts datafile '/data/u1/db1/data1.dbf' size 10000M autoextend off
ERROR at line 1:
ORA-19502: write error on file "/data/u1/db1/data1.dbf", blockno 231425
(blocksize=8192)
ORA-27069: skgfdisp: attempt to do I/O beyond the range of the file
Additional information: 231425
Additional information: 64
Additional information: 231425
Do anyone know what's wrong?
Thanks
david

I've finally solved it!
I downloaded the following jre from blackdown:
jre118_v3-glibc-2.1.3-DYNMOTIF.tar.bz2
It's the only one that seems to work (and god, have I tried them all!)
I've no idea what the DYNMOTIF means (apart from being something to do with Motif - but you don't have to be a linux guru to work that out ;)) - but, hell, it works.
And after sitting in front of this machine for 3 days trying to deal with Oracle's, frankly PATHETIC install, that's so full of holes and bugs, that's all I care about..
The one bundled with Oracle 8.1.7 doesn't work with Linux redhat 6.2EE.
Don't oracle test their software?
Anyway I'm happy now, and I'm leaving this in case anybody else has the same problem.
Thanks for everyone's help.

Error in Inbound File Adapter

Hello,
The scenario :
Flat File => XI => Enterprise (4.7)
I'm getting the following error in the Adapter Engine at time of Reloading the new inbound file adapter.
==========
<i>***** Tue Jul 06 11:46:54 EDT 2004 *****
11:46:59 (4023): File adapter initialized successfully
11:46:59 (4007): File adapter started
11:47:03 (4050): ERROR: Unexpected exception "com.sap.aii.messaging.adapter.ftp.FTPEx: Unknown extension in database file name." occurred</i>
==========
The inbound file adapter is as below ... :
==========
<i>classname=com.sap.aii.messaging.adapter.ModuleFile2XMB
mode=FILE2XMB
XMB.TargetURL=http://host123:8001/sap/xi/engine?type=entry
XMB.SenderBusinessSystem=Sender_System
XMB.SenderInterfaceNamespace=http://abc.com/xi/
XMB.SenderInterfaceName=DataFile_Out
XMB.User=xisuper
XMB.Password=xipass
XMB.ReceiverBusinessSystem=ENT
XMB.ContentType=text/plain
XMB.ContentKind=T
XMB.QualityOfService=EO
file.sourceDir=
file.sourceFilename=DATAFILE
file.processingMode=test
file.pollInterval=060
ftp.host=100.200.300.400
ftp.port=21
ftp.user=userid
ftp.password=passwd
ftp.mode=Text</i>
==========
Any help is greatly appreciated.
Thanx in advance.
Homiar.

All,
Problem is solved. I changed the value for the Source directory & the adapter started to poll.
Thanx,
Homiar.

Get File name of the inbound file during mapping

Scenario: to read the file name of the inbound file (which has date required for the mapping) during runtime.
The requirement is to read the date of the inbound file (passed to the XI pipline by the file adapter) and populate the same in the outbound mapping structure.
Any idea about how to do this?
(I went through few options of using java.util.map. not successful yet)

Hi Anand,
I posted the same question a time ago, without any help....
Can I find out the full filename of input file in message mapping?
Posted: Nov 23, 2004 1:00 PM
I have in XI 2.0 the following scenario :
In the inbound fileadapter I read my input file. The filename of the input file is part fixed, part variable (Like INDATA01.txt, INDATA03.txt, etc).
So in my Adapterconfiguration, I specify the filename with a wildcard (INDATA*.txt).
What I now want to do, is in my Message Mapping use the full filename , so I can do something different for every filenumber. Is there a way where I can get the full filename available in my message mapping (I did not find the filename in the XML in the message trace).

Large excel files won't combine to pdf in Acrobat X or XI

I have large Excel files (0.3 to 1.2 MB) that I used to combine into a single pdf. It will only work now on Excel files smaller than 1MB. This was working a few weeks ago. What happened? I have tried on computers that have both Acrobat X and XI (we have both scattered around our building).
Any ideas? Thanks.

FileOpen is a security add-on, which is needed to open some files. Not a part of Adobe software. Maybe you need to upgrade or report it: http://www.fileopen.com/

How to increase performance speed of Photoshop CS6 v13.0.6 with trasformations in LARGE image files (25,000 X 50,000 pixels) on IMac3.4 GHz Intel Core i7, 16 GB memory, Mac OS 10.7.5? Should I purchase a MacPro?

I have hundreds of these large image files to process. I frequently use SKEW, WARP, IMAGE ROTATION features in Photoshop. I process the files ONE AT A TIME and have only Photoshop running on my IMac. Most of the time I am watching SLOW progress bars to complete the transformations.
I have allocated as much memory as I have (about 14GB) exclusively to Photoshop using the performance preferences panel. Does anyone have a trick for speeding up the processing of these files--or is my only solution to buy a faster Mac--like the new Mac Pro?

I have hundreds of these large image files to process. I frequently use SKEW, WARP, IMAGE ROTATION features in Photoshop. I process the files ONE AT A TIME and have only Photoshop running on my IMac. Most of the time I am watching SLOW progress bars to complete the transformations.
I have allocated as much memory as I have (about 14GB) exclusively to Photoshop using the performance preferences panel. Does anyone have a trick for speeding up the processing of these files--or is my only solution to buy a faster Mac--like the new Mac Pro?

Can't download large pdf file

I'm trying to download a large pdf file (26.2 mb) to my iPad. It appears to download, then appears, as 440 blank pages. It offers to open the file in iBook, but that also doesn't have any results. Is there a limit on the size of the pdf file it can handle? I tried to e-mail it from my computer, but the file is too big for my e-mail program. This is a book I would really love to read on the iPad--how can I get it there? thanks, B.

Yes, I see that as well. Talk about a bad assumption. I thought from what I had read that the feature worked like Spotlight on the Mac. In fact I could swear I've read that on Apple's site somewhere. Not the first time I was wrong and certainly not the last. Alas I stand corrected again.
Frankly, after investigating the search function further - IMHO - it seems pretty useless. A number of the apps that I use have their own search functions built in. I've read that you can search for a missing app on your iPad with this feature, but other than that and finding contacts and emails it seems pretty pointless to me.

Is there a good way to add a large music file to itunes match without itunes crashing?

I have several large music files that are DJ sessions and anywhere from 1-3 hours long. I deleted them from itunes while matching because they were causing match to crash at step 3 every time. I would like to add these files into match now but every time I try, it crashes again. Anyone know of a work around for this?

The iTunes Match service is designed to exclude such Songs. Perhaps handling them as Podcasts would help you.

Large Inbound file

Similar Messages

Maybe you are looking for