How efficiently Big Size file can be processed

Hi,
I am given a specific problem for Big size Matrix data handling.
In a File there are Huze data in the Matrix form (m*n) - These data basically represents some image pixel value.
say for example I am give a pixel value of leena image of size 5MB.
What should be the efficient logic for faster reading of the File and put it in a Data Structure,
What should be the efficient Data structute to hold that huge data (data range varry from 0-255)
Thank you
shankha

Do you want to know how to load an image? http://java.sun.com/docs/books/tutorial/2d/images/index.html
BTW, 5MB isn't "huge".

Similar Messages

Does Adobe Send allow you to select how many days your files can be downloaded - as with Adobe Send Now? Also, why don't I see the virus scanning message any longer with "Send" versus "Send Now"?

Does Adobe Send allow you to select how many days your files can be downloaded - as with Adobe Send Now? Also, why don't I see the virus scanning message any longer with "Send" versus "Send Now"?

We relied upon the "days available for download" to get people to take
action more quickly. The "virus scanning" progress bar was simply another
way of knowing this activity was actually taking place - unless this is
written somewhere in the Adobe Send User Guide.....wherever that is.
On Tue, Dec 2, 2014 at 12:09 PM, bob.treitman <[email protected]>

How to find Open Files by a Process Solaris 10

Hi,
Hope you are doing well.
I'm trying to get open files by a process in solaris 10 using "pfiles" with below command:
pfiles -n `ps | grep -i "data -log" | grep -v grep | grep -i uatrate | awk '{print $2}'` | wc –l
When I put this in some shell script like below then this command is not giving any output. Your assistance is required in this. Please guide me so that I can get the Count of Open files by some process.
I made some script, Its working fine but its giving the output for whole processes:
#!/bin/ksh
let "TOTAL_OPENED=0"
for A_PID in `ps | grep -i "data -log" | grep -v grep | grep -i uatrate | awk '{print $1}'`; do
FILES_OPENED=`/usr/proc/bin/pfiles -n $A_PID 2>/dev/null| grep "ino:" | wc -l`
let "TOTAL_OPENED = TOTAL_OPENED + $FILES_OPENED"
done
echo "Opened files = $TOTAL_OPENED"
Many Thanks in advance.
Imran Qasim.

Have you tried "man top" to see the documentation for the top command?
How about the following: http://lmgtfy.com/?q=show+memory+with+top+command
The 5th column (VIRT) shows the amount of RAM + swap
The 6th column (RES) shows RAM
The 7th column (SHR) shows memory shared between processes

How to design multiple file polling BPEL process?

Hi all,
I am trying to solve/design the following in BPEL process:
- The integration process flow I am trying to design is an interaction b/n system A (FTP server), an Integration platform and system B.
- The integration platform will poll files from an internal FTP server. It has 2 Time files (“Time1” and “Time2”) alternatives to poll from the FTP server. It will then transform the message/information inside the files (time information) to an internal XML format. At the end it shall send the message to system B.
- The information inside the files is identical. The reason to have 2 files with identical information is for redundancy. The integration-platform shall only poll file “TIME1” as long as the conditions are met. If the conditions are not met, then it polls file “Time2”.
Normal succeeded scenario:
1- The integration platform polls the latest “Time1” file from the internal FTP server. The polling is done every 15th minute.
2- The integration platform logs to BAM and reports that the file is received.
3- The platform then converts the message to an internal format.
4- The platform sends the converted message/time information to system B.
5 - The use-case ends.
Not normal scenario:
1- The platform cannot get/receive file “Time1” file.
- The platform logs to BAM and reports that the file could not be received.
- The platform polls file “Time2” from the FTP server and it does the same normal scenario as above. The use case ends.
2 - Time message/information from the Time1 file has not full information (less than 24 rows). The file is supposed to have 24 rows (for 24 hours).
- The platform logs to BAM and reports that there is missing information on the message.
- The platform gets/polls instead the “Time2” file from the FTP server and it does the normal scenario.
- The use case ends.
3- The platform can find/get neither file “Time1” nor “Time2”.
- The platform alarms to BAM that it could not get/find the files.
** I am considering either the pick activity or the switch activity solution. Does any one of you have an idea how to design this in oracle BPEL process?
Thanks.

Not sure I understand your use case completly so if I'm off track I apploigise.
I think there are 3 ways to solve this. The 3rd may be closest to what you are looking for.
1. Have 2 processes that read into a common area, e.g. database where you can compare. From there you can choose which file to pick. This is high leve but I think this would be dificult to implement.
2. Implement a combination of a rejectedMessage handler and error processing witn the BPEL process itself. The rejecte message handler can call another BPEL process if the time1 file is in a invalid state. This process will then read the time2 file. The issue with this is that the rejecte message handler will only get invoked when the file doesn't conform to the schema.
3. Use the quarts scheduler whcih invokes a BPEL process every 15 miniutes. Using the file adapter to perform a synchronous read to read time1, analyse it, if it fails read time2 using synchronous read. Then perform the approprate action id this fails.
hope this give some ideas.
cheers
James

How to Upload a File in Bpel Process using JSP

I am trying to upload file in bpel process using front end as a Jsp.
i create the jsp page and i am able to pass the value from jsp to bpel process.
In bpel process i don't know how to pass or assign the specified file name into file adapter for reading the files.
Please help me...
Saravanan

You don't assign the url of the file to it.
To either get the data from the file into the bpel process you could use the url-parameter together with the ora:readFile function....or you could let your web-application upload the file to some location on the server...and on this location you could use the file-adapter together with the polling, to start your bpel process.

I can't copy big size files to my 1TB external after lion up

I have a 1 TB external HDD, 2 partitions a 174.5GB MAC OS EXTENDED used as a backup and an 825.23 MS-DOS(FAT32) for everything else. before i upgraded to LION it works fine. after LION i copy a 800MB movie file to either of the 2 partitions it shows the file being copied and the gray file icon is there but after the process is complete the file isnt there and the HDD size doesnt change. while when i try to copy a 7GB file to either of the partitions this message appeares (The item “123.mkv” can’t be copied because it is too large for the volume's format).
am using a macbook 13" dual core 2.4ghz 4gb ram. ---
i tried my brother's HDD and i faced the same issues. however on his MBK its fine.
i honestly don't want to try and restore before LION and do the process again coz i would have to download LION again, and i also can't transfer the files on the external HDD coz its too big and i don't have anywhere to put them.
if anyone has a solution please do post. otherwise i would have to re-do 30hrs woth of work again coz its not backed up
thanx

HI,
That's kinda strange, i really believe i have tried to copy files larger than 4GB to the HDD before on leopard, but maybe am confused on that.
i repaired the permissions on all the HDDs even the enternal one.
and i actually tried a document file of maybe 60KBs and the same thing on both partitions.
i think the good news is that i checked on the backup of TimeMachine and yep it backedup files "weooh" i tried and created files on my own and checked the back up and its there.
the weired thing is when i try to copy those same file my self ( Drag n Drop or Copy n Paste) its not working on either partition.
i would really appreciate a solution where i wont have to restore to leopard and re-install lion, i would be happy to provide who you with more detail if you might be able to help
cheers,
Anas

How many view/FML files can I have?

Guys,
We are running Tux 6.5 and in the process of combining multiple applications,
we have in excess of 100 view files lined up in our VIEWFILES32 environment variable.
Is there a limit on how many we can have? How about FMLs?
Thanks,
Ed Blank

I don't believe there is any limit beyond the limit on the size of an environment
variable or the memory of the process. I did see a problem reported on VMS, but if
you are not on VMS, I wouldn't worry.
Compiled Viewfiles can be concatenated if you like.
This is just based on a quick look at the code, so I'm not promising that the
above is correct. Maybe someone wants to try it and let us know.
Eb Blank wrote:
Guys,
We are running Tux 6.5 and in the process of combining multiple applications,
we have in excess of 100 view files lined up in our VIEWFILES32 environment variable.
Is there a limit on how many we can have? How about FMLs?
Thanks,
Ed Blank

How to Create Excel File in Background processing with different colors

HI All
I am trying to create Excel file in background & send it to user through e-mail, this i could acheive using fucntion module SO_DOCUMENT_SEND_API1, but here my requirement is i want to put different colors to columns of excel & this should happen in Background processing,
Initially i completed above requirement by using HTML type of document with attachment type 'ALI' & formatted output using write statement & used colors, after that i took this o/p using save_list function module & then table compress...etc.
but i don't know how to achieve same if we need o/p in excel as size of object of excel file is less than that of HTML
I am thankfull to everybody who will help me.
Regards
Lokesh

Lokesh,
Iam also trying to populate my text file with colors as an attachment . If you know this please let me know.

Maximum IMD size that can be processed by Meter Data Management v2.x

Does anyone know the maximum IMD size that MDM 2.x can process? I was trying to process an MV90 Interval IMD with 15 minute cuts for a period of 6 months (trying to load historical usage in one go). MDM is timing out and failing to process the IMD. The IMD has been created and is failing when I am trying to do Additional Processing (with just a dummy VEE group so no 'real' validation is happening).
Edited by: user12984550 on Jun 4, 2012 1:15 PM

You have to options:
1. The router that is internal must have a static route to the ASA to reach the VPN networks and must have a distribute static so that other routers that form part of EIGRP know how to route to the VPN networks.
2. You can configure on the ASA "set reverse-route" on the crypto map then configure EIGRP on the ASA and add redistribute static so that routes learned via VPN (considered static routes) can be pushed through EIGRP.

Illustrator cc 2014 dosen't open old big size file Black screen and crashing

I installed illustrator cc 2014 I can not open some of my old files... black screen on waiting.... Meanwhile writes above is not responding If file size is larger it's a problem My OS Windows 8,1 pro "Please help"

Hi,
This seems to be activation issue,
Please sign out from Creative cloud desktop app and Quit it.
quit all the Adobe applications
Assuming you're on Windows machine
Go to the following location and rename Adobe folder to old.Adobe
C:\Users\<Username>\AppData\Roaming
C:\Users\<Username>\AppData\Local
Then try to launch Creative Cloud Desktop app and Sign in with your Adobe ID and Password.
and Launch Premiere pro, hope that helps.
Thank you,

How "old" of a file can Logic 8 open?

ok, this is going to sound funny but... I've got this friend (seriously) that just got Logic Studio. They are trying to open a Logic file that we did together back on ver. 4.7 and I'm being told that Logic won't open the file. They're getting an error message saying something about opening a 7.3 file instead (sorry I couldn't get the full error message from them).
Does anyone know of a "cut off" in regards to how far back L8 can go when opening older Logic songs?
Thanks much!

Thanks for the info. I tried to open an older file as well to see if I had the same problem my freind was... So it would seem that Logic 5 is the cut off. Logic Pro 8 cannot open files created any earlier than that! I just tried to open a backup file from 2002 and I get a message saying that "this format is not compatablewith this Logic Pro version. Please load first into Logic Pro version 7.2.1 or earlier to convert this project". That only be mildly annoying if I.. oh, had a verion of 7.2.1 available. Do I need to uninstall 8, try to find a version of 7.2.1, go through all my old files, ere save them, uninstall, reinstall... I believe the word is.. OYE!!!!
Now THAT... is not good news. I've got tons of archival files from around that era and never deramed I'd not be able to open them a mere 5 years later. I'm sure there's a work around for this and obviously, my fiend and I aren't the only ones that are going to run into this.
Thanks again for the feedback and help!

How small of a file can I make to hold three hours of audio?

I currently have a 3 hour audio segment that is about 200MB. Can you give me some tips on what I can do in Garage Band to make this file smaller? I export the audio in MP3 when I'm done.
Thanks!

if these are audio recordings, and high quality is not most important, Save As and "Compact"

Small size file can not read correctly on other linux

Hi, I am running archlinux 0.8 on my laptop, and there is another linux runs kernel version 2.6.20 with root filesystem of debian v3.1.
I wrote a shell script which reads a small, 49 bytes, only 1 line conf file on my archlinux, it works fine.
But if I copy script & conf files to debian, the script can not read conf file with:
while read f;do; echo $f; done < conf
but `cat`,`more` commands can read it. I have to open conf file with vi on debian and do nothing but :wq rewrite it to make script working.
Both arch & debian use ext3 file system. Could anyone tell me why? thanks.

I think your command is wrong: it works with zsh and doesn`t work in bash. Maybe you should remove extra ';'?
while read f;do echo $f; done < conf

Problem downloading big size files

Hi,
I am trying to add on my web application an hyperlink to let the user download a compressed file.
I am using the servlet to perform the transferring of the file.
Everything works perfect when the size of the file is small, otherwise I get a file smaller than the original one and the archive results to be corrupted.
Is there a limit somewhere on the hyperlink component or elsewhere?
To perform the transfer I am using the following object:
public class DownloadZip {
    /** Creates a new instance of DownloadZip */
    public DownloadZip(String fname, String mtype) {
        FacesContext faces = FacesContext.getCurrentInstance();
        HttpServletResponse response = (HttpServletResponse) faces.getExternalContext().getResponse();
        try{
        ServletOutputStream outputStream = response.getOutputStream();
        String filename = fname;
        String mimetype = mtype;
        if(mimetype == null || mimetype.length() == 0)
            mimetype = "application/octet-stream";
        response.setHeader("Content-Disposition","attachment; filename=\"" + filename + "\"");
        response.setHeader("Cache-Control", "cache");
        response.setHeader("Cache-Control", "must-revalidate");
        response.setHeader( "Pragma", "public" );
        File results=new File(path_name+filename);
        response.setContentLength((int) results.length());
        response.setContentType(mimetype);
        FileInputStream in = new FileInputStream(results);
        BufferedInputStream fis = new BufferedInputStream(in);
         int i = fis.read();
        while (i !=-1)
     try
             outputStream.write(i);
          i = fis.read();
     catch(IOException e)
          e.printStackTrace();
          break;
    outputStream.flush();
    fis.close();
    outputStream.close();
    catch(IOException e)
          e.printStackTrace();
}Please tell me what I am doing wrong.
Eva.

Yes. This is an issue. JavaFX team is working on enhacing HttpRequest API so as to allow huge data transfer. There are couple of new attributes added which will allow to do data transfer without buffering. Also Integer (used in may APIs) will be changed to use Long (new supported data type) to handle larger data. These changes will be available in next release - 1.2

FTP how much large file can take?

Hi Experts,
can you please any one tell me FTP,how much large size file can pull.maximum size of FTP?
Thanks
narendran

Hi Narendan,
if you read the question 14 (Q: Which memory requirements does the File Adapter have? Is there a restriction on the maximum file size it can process?) in this note 821267 - FAQ: XI 3.0 / PI 7.0 / PI 7.1 / PI 7.3 File Adapter , shows that the size restriction depends about several factors, i recommend that you read it.
Check also this thread Size recommendation for placing file from FTP to Application Server??
Also, i suggest that you read this blog if you would need to work with big files: File/FTP Adapter - Large File Transfer (Chunk Mode)
Regards.

How efficiently Big Size file can be processed

Similar Messages

Maybe you are looking for