Message Data Compression

I'm not exactly new to java, I've just been away from it for a few years.
I'm trying to create an XML-based messaging system for communication between a suite of applications. XML being what it is (verbose text) I want to apply data compression. (In the short term, during development, the messages will be between components on a single machine. Ultimately, the applications will likely run on many machines and use the internet to communicate with each other.)
I was looking at the java.util.zip tools, but I'm not actually creating files. I thought I could use just the ZipEntry part, but it's not coming together well. I was also thinking some flavor of SOAP might serve my needs, but SOAP has come onto the scene during my absence from development activities. I've got to familiarize myself with it a bit more before I can assess whether or not it fits my needs.
I'm open to suggestions as to how I should approach this. All ideas anyone cares to share are greately appreciated.
- Patrick

The system will probably use a combination of RMI and JMS, but that's not anything I want to bring into the question at hand.
The only problem I'm concerned about right now is, "How do I compress a packet of data?" What I do with that packet of compressed data is a problem for a different level of abstraction. I've got a fairly large buffer of XML that I want to compress before passing off to another entity to act upon. What's the best way to do that?
- Patrick

Similar Messages

How do I do data compression when message is sent over RMI-IIOP

Hi,
Is there a way one can do data compression/de-compression when message is sent over RMI-IIOP ?
Regards,
Sourav

To elaborate on Tammy's idea, you could use for instance C:\Users\Public at the place where you initially put your Excel file to make sure this is found on the target computer. I would consider this a workaround though.
Or for Lumira documents that you already designed, change the location of the Excel file and use Data/Edit from your computer, then save the Lumira documents before sending them to the target audience.
From my humble opinion, the product should allow to use Data/Edit and change the source file even if the initial file path is no longer found. This should be possible for your target audience.
Antoine

Data compression in xi

Hi ,
How do you do data compression in xi?
thanks in advance,
Ramya Shenoy

Hi Ramya,
Are you talking about the archiving of the messages in the XI server. Or compressing individual XI message as parteek has explained in his reply uisng the PayloadZipBean.
Thanks
Ajay

Error in FI data compression

Hi Gurus,
I have made summarization in obcy as per 36353 note,uploaded the program(zttypv) as per correction instruction & made vbrk table -``/field - ``
I created billing document but I am getting this error when try to release the document through t/code VFX3.
The detail of the error at VFX3
9056500667 000000 Error in FI data compression
     LongText
         Detail
          Diagnosis
              The data in the FI document should be summarized via field
              ''. However, the system could not find this field in the
              internal structure (see 'LFACIGEN').
          System Response
              This error stems from inconsistencies between the data base
              tables of the FI document and the internal summarization
              structure.
          Procedure
              Start program 'SAPFACCG', in order to reset the internal
              structure, and then check whether field '' is in
              'LFACIGEN'. enthalten ist.
I HAVE TRIED THE PROGRAM "SAPFACCG" TO EXECUTE
BUT IT IS NOT,IT IS SAYING IT NEED TO BE RESTARTED NOW HOW TO RESTART???
REPORT SAPFACCG MESSAGE-ID F5.
Generating compression structure P_ACC in LFACIGEN.
This program has to be restarted in case of problem with compression
(Message F5 843)
CALL FUNCTION 'FI_DOCUMENT_INIT'.
Is there anyway to resovlve this issue
Thanks in advance
Umed

Hi
I have uploaded the program(zttypv) as per correction instruction & which has made in TTYPV as object type-vbrk, table -``/field - ``,now same thing is reflecting in OBCY as vbrk table -``/field - ``
umed

Re: Data Compression

-----Original Message-----
From: Jose Suriol <[email protected]>
To: 'Forte mail list' <[email protected]>
Date: Friday, February 27, 1998 1:00 PM
Subject: Data Compression
>
Thanks to all who replied to my post about Fort

>
Thanks to all who replied to my post about Forte compressing
data before sending them to the network. It appears Forte tries to
minimize the size of certain data types but does not do compression
across the board. As I understand Forte Version 4 will probably
support the Secure Sockets Layer (SSL) which has a data compression
option, but unfortunately SSL is, first and foremost, a secureprotocol,
and while compression is optional, encryption (a CPU intensive process)
in not.
Encryption, integrity and compression are all optional in SSL.
Its possible to request a connection that only has compression, assuming
that the
other side agrees.
Derek

Http Data Compression

Is there any Http Data Compression support in WLS 6.1 or 7.0 ?
There are tools for the IIS and Apache server. This helps the network
performance and downloading time.
www.ehyperspace.com
http://www.innermedia.com/Products/SqueezePlay_IIS_Real-Time_Web_/squeezepla
y_iis_real-time_web_.htm
thanks
/selvan

There are no generic solutions for Weblogic 5.1.
We support filter-like functionality for Weblogic 5.1 with our EnGarde
software, but we only provide it through OEM contracts (no direct sales).
Sorry.
You can use a "front component" to route all requests to other servlets/JSPs
yourself, but if you do substitution with a "front component", you'll have
to extend the WL classes themselves (request, response), which gets tricky.
Peace,
Cameron Purdy
Tangosol, Inc.
http://www.tangosol.com/coherence.jsp
Tangosol Coherence: Clustered Replicated Cache for Weblogic
"Selvan Ramasamy" <[email protected]> wrote in message
news:[email protected]..
Yes, I totally forgot about the filters ... Thank you .
What will be your suggestion for the Weblogic 5.1 server ? As most of my
customers are using the weblogic 5.1.
thanks
"Cameron Purdy" <[email protected]> wrote in message
news:[email protected]..
Cameron, how can I do this so that I don't have change all of my jspsand
servlets ?
Should I plug a custom ServletResponse to do this ?In 6.1 (maybe) or 7.0 you can use a filter, which is like a Servlet that
substitutes its own Request and/or Response object.
Peace,
Cameron Purdy
Tangosol, Inc.
http://www.tangosol.com/coherence.jsp
Tangosol Coherence: Clustered Replicated Cache for Weblogic
"Selvan Ramasamy" <[email protected]> wrote in message
news:[email protected]..
>

Error Message: Data from Business Add-In ME_PROCESS_PO_CUST not transferred

Hi All,
I have done a BADI implementation for ME_PROCESS_PO_CUST and when I try to convert a PR to PO using ME59N in ECC u2013 AFS System I am getting below error message.
Data from Business Add-In ME_PROCESS_PO_CUST not transferred.
I am trying to populate certain PO fields ( ekko and ekpo ) from PR fields. But the above error occurs when I update the Ex Factory Date manual that is EKPO-J_3AEXFCM.
I am updating this in the method PROCESS_ITEM and what I found while debugging is in the class CL_PO_HEADER_HANDLE_MM, in the implementation of IF_FLUSH_TRANSPORT_MM~START, the contents of field u2018my_iteration_countu2019 keeps increasing and becomes 10 and raises this error.
I read few of the related questions raised by others in this forum and understood that this can happen if I try to change the field that is disabled ( greyed) in ME22N. But this field that I am talking about is enabled.
I also tried to move my code of populating the field EKPO-J_3AEXFCM from the PROCESS_ITEM to the enhancement point just above the user exit EXIT_SAPMMO6E_018 but still it doesnu2019t resolve the error.
(We donu2019t want to use User Exit and hence we are trying with BADIs or enhancement point.)
Can anyone please help me with this. I also found an OSS note 1334046 but not sure if that can resolve my issue.
Thanks in advance.
Ameesha.

Hi Ameesha,
i think u need to implement the BADI ME_PROCESS_PO_CUST in SPRO settings.
SPRO>Purchasing>Business Add-in Purchasing-->BAdI: Enhance Processing of Enjoy Purchase Order
try this once.
All check this link.
[Error Message: Data from Business Add-In ME_PROCESS_PO_CUST not transferred;
Hope it helps.
Regards,
Raj

Error Caller 09 contains error message - Data Marts loading(cube to ODS)

Dear all,
          Please ! Help me in this problem, This is very urgent.
          I have one process chain that loads data from BIW to BIW only through Data Marts. In that process chain, one process loads data from one cube(Created by us) & loads data to one ODS(also created by us). Data is loaded through full update & for the selected period specified in 'Calender Day' field in data selection.
         Previously I was able to load data for 2 months, but some days ago, suddenly one day, the process of Extraction got stuck in background for long time,& showed following error :
          Error message from the source system
          Diagnosis
         An error occurred in the source system.
          System Response
         Caller 09 contains an error message.
         Further analysis:
         The error occurred in Extractor .
         Refer to the error message.
         Procedure
         How you remove the error depends on the error message.
         Note
         If the source system is a Client Workstation, then it is possible that the file that you wanted to                load was being edited at the time of the data request. Make sure that the file is in the specified directory, that it is not being processed at the moment, and restart the request.
              Then we killed that process on server & after another attempt, It showed some calmonth...timestamp error. Then after reducing data selection period, It had been loaded successfully, after that I was able to load data for 20 days,Again after some days process got stuck,I followed the same procedure,reduced the period to 15 days & continued, Now I can't even load data for 5 Days successfully in one attempt, I have to kill that process in background & repeat it, then sometimes It get loaded.
         Pls, suggest some solutions as soon as possible. I am waiting for your reply. Points will be assigned.
         Thanks,
          Pankaj N. Kude
Edited by: Pankaj Kude on Jul 23, 2008 8:33 AM

Hi Friends !
                  I didn't find any short dump for that in ST22.
                  Actually , What happens is, Request continues to run in background for infinite time. At that time
Status Tab in Process Monitor shows this messages :
                    Request still running
                    Diagnosis
                    No errors found. The current process has probably not finished yet.
                     System Response
                     The ALE inbox of BI is identical to the ALE outbox of the source system
                       or
                     the maximum wait time for this request has not yet been exceeded
                       or
                    the background job has not yet finished in the source system.
                   Current status
                   in the source system
                    And Details Tab shows following Messages :
                    Overall Status : Missing Messages or warnings
                    Requests (Messages) : Everything OK
                            Data Request arranged
                            Confirmed with : OK
                     Extraction(Messages) ; missing messages
                            Data request received
                            Data selection scheduled
                            Missing message : Number of Sent Records
                            Missing message : selection completed
                    Transfer (IDOCS and TRFC) : Everything OK
                            Info Idoc1 : Application Document Posted
                            Info Idoc2 : Application Document Posted
                     Processing (data packet) : No data
                    This Process runs for infinite time, then I have to kill that process from server, & Then It shows Caller 09 Error in Status Tab
                    Should I Changed the value for that memory parameter of server or not ?. We r planning to try it today, Is it really belongs to this problem, Will it be helpful ? What r the risks ?
                    Please, give your suggestion as early as possible, I m ewaiting for your reply.
Thanks,
Pankaj N. Kude

How do I get rid of saved messages data on my phone?

I have an iPhone that only has 8gb and I'm in desperate need of space until I'm able to upgrade. When I look at Usage, it says I have 1.8gb of saved messages. I deleted all the threads and rebooted but the data hasn't gone away. I also have a MacBook that saves the message data (which I want) so why is my phone saying the data is still stored on my phone? How can I get the data off my phone and can I do it and still keep the messages on my MacBook? Thanks!

This is covered in the User's Guide along with all other basic functionality.
Press and hold the home and power buttons for 15-20 seconds until the white Apple logo appears.

How do you fix error message "data rate for this file is too high for DVD. You must replace this file with one of a lower data rate".

When trying to burn a DVD it will go through the encoding step and at 98% we see the message 'data rate for this file is too high for DVD. You must replace this file with one of a lower data rate". We need help to correct this so we can complete burning to DVD.

What did you export from Premiere?
Did you use the MPEG2-DVD preset... and did you make any changes to the preset?
CS5-thru-CC PPro/Encore tutorial list http://forums.adobe.com/thread/1448923 may help

File Adapter Data Compression

I'd like to extend file adapter behavior to add data compression features like unzip after read file and zip before write file. I read oracles's file adapter documentation but i didn't find any extension point

if its java mapping, just create a DT with any structure as you wish.
ex.
DT_Dummy
|__ Dummy_field
java mapping does not validate the xml against the DT you created

How to update the Input message data in OSM

hi,
I am using OSM 7.0.2.
can we update input message data before the orchestration execution.
I want to add some more order line item to the input xml by calling some external webservice.
Suppose CRM submits order with 3 order line item. Now once we have that in Input message i want to add some more order line item to this input message.
I dont want to add processing/adapter layer above OSM that does the updation of the XML.
Thanks in advance.
Rutvej

Hi Rutvej,
You use Order Data Rule to generate data for the creation view of the orchestration order. The source schema of the Order Data Rule is the schema for the incoming message. The output returns the <_root> portion of the creation view. Note that the Order Template already has the Sales Order (look for "order <XML>") and automatically populated by OSM Core. So, what you are trying to do is not to add/change the Sales Order itself, but to first add the desired enriching data model into Order Template, and then use Order Data Rule to populate those enriching data into the Order Template.
Example of Order Data Rule:
declare namespace cso="http://xmlns.oracle.com/communications/sce/dictionary/CentralOMManagedServices-Orchestration/CustomerSalesOrder";
let $customer := //cso:CustomerAccount
return
<_root>
     <OrderHeader>
          <AccountIdentifier>{$customer/cso:AccountID/text()}</AccountIdentifier>
     </OrderHeader>
     <EnrichedOrderItem>
          <Data1>Your enriched data here</Data1>
          <Data2>Your enriched data here</Data2>
     </EnrichedOrderItem>
</_root>
Before that, you would need to add the OrderHeader and EnrichedOrderItem into the Order Template.

All the message dates in the message list changed in every mailbox to a recent date, I don't know why.. The dates within the messages' headlines themselves remained correct. How do I re-establish the correct dates also in the mailboxes' message list?

All the message dates in the message list changed in every mailbox to a recent date, I don't know why.. The dates within the messages' headlines themselves remained correct. How do I re-establish the correct dates also in the mailboxes' message list?

First thing is to forget all the complex configs and just try to schedule the report to run once now, no alerts, no notifications, no nothing.
Does that work?
Then you can build up the schedule, to see where the problem is coming from.
Sincerely,
Ted Ueda

XI message data

Hi All,
We are currently facing a scenario which is required to get all the message data( XML data from the messages) processed through few interfaces in an XI system. Do we have any tools or methods available to download the message data from xi systems?
(one method is to fetch the messages flown through adapter engine from the table xi_af_msg from db level)
Looking forward for your valuable suggestions.
Thanks& Regards
Aby

Hello,
U can fetch data by using this blogs from abap tables
https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/b050ff4f-84c3-2b10-3d99-8f9c44f57a17
https://www.sdn.sap.com/irj/scn/wiki?path=/display/snippets/pi%2bmonitoring%2bfunctionality%2b-%2bfetching%2bdata%2bfrom%2bsxmb_moni%2bstandard%2btables%2b-%2bpart%2bi
Thanks and Regards
Hemant

Using Data Compression on Microsoft SQL 2008 R2

We have a very large database which keeps growing and growing. This has made our upgrade process extremely troublesome because the upgrade wizard seems to require close to 3 times the database size of free space to even start.
As such, we are considering activating DATA COMPRESSION on the PAGE level in Microsoft SQL Server 2008 R2. This technology is native to the SQL Server and compresses the rows and the pages so that they do not take up more space than necessary.
Traditionally each row take up the space of the maximum of all the fields even though only part of a field is filled with data.
[Blog about Data Compression|http://blogs.msdn.com/b/sqlserverstorageengine/archive/2007/11/12/types-of-data-compression-in-sql-server-2008.aspx]
Our idea is to use this initially on the Axxx tables (historic data) to minimize the space they take by using for example:
ALTER TABLE [dbo].[ADO1] REBUILD PARTITION = ALL
WITH (DATA_COMPRESSION = PAGE)
On a test database we have seen tables go from 6GB of space to around 1,5GB which is a significant saving.
MY QUESTION: Is this allowed to do from SAP point of view? The technology is completely transparent but it does involve a rebuild of the table as demonstrated above.
Thanks.
Best regards,
Mike

We are using Simple recovery model, so our log files are pretty small.
Our database itself is about 140GB now and it keeps growing.
We've also reduced the history size to about 10 versions.
Still, some of our tables are 6-10GB.
Some of the advantages of data compression is to also that it improves disk I/O at the cost of slightly higher CPU, which we are pretty sure our server can handle.
Mike

Message Data Compression

Similar Messages

Maybe you are looking for