Problem in writing to CSV file

Hi all,
i am retreiving a long String which is not in a proper format (ie) Lot of Spaces in between and my String contains comma(,) seperated and I am trying to put that string in to a CSV file. I am able to write the data in the CSV file but not in a proper format.i need to write the data in the below format.
For Ex:
Emp-No,Address,Name,Manager -------> this is Heading
1000,abcd,name,Man-name -----> After i have to put the data in next line
My String will be like this,
abcd , , , jsjsj, , ,saalkj,jfjfjfjf,mmm, nnn, , ,
I am able to get the data properly in the CSV format.
Please help me to solve this. Thanks in Advance!!!!

Are you using any reporting frameworks like Jasper
Reports or you using simple select queries in MySQL
to export the data to CSV format.Detail more clearly
to get assist from others.
Are you using Session beans or Entity beans on Weblogic?no no no, he can create the csv file, whether its in the correct format is the problem of the consumer of this csv file, isnt'it?
are you using a microsoft product?

Similar Messages

Memory problem with loading a csv file and displaying 2 xy graphs

Hi there, i'm having some memory issues with this little program.
What i'm trying to do is reading a .csv file of 215 mb (6 million lines more or less), extracting the x-y values as 1d array and displaying them in 2 xy graphs (vi attacked).
I've noticed that this process eats from 1.6 to 2 gb of ram and the 2 x-y graphs, as soon as they are loaded (2 minutes more or less) are really realy slow to move with the scrollbar.
My question is: Is there a way for use less memory resources and make the graphs move smoother ?
Thanks in advance,
Ierman Gert
Attachments:
read from file test.vi ‏106 KB

Hi lerman,
how many datapoints do you need to handle? How many do you display on the graphs?
Some notes:
- Each graph has its own data buffer. So all data wired to the graph will be buffered again in memory. When wiring a (big) 1d array to the graph a copy will be made in memory. And you mentioned 2 graphs...
- load the array in parts: read a number of lines, parse them to arrays as before (maybe using "spreadsheet string to array"?), finally append the parts to build the big array (may lead to memory problems too).
- avoid datacopies when handling big arrays. You can show buffer creation using menu->tools->advanced->show buffer allocation
- use SGL instead of DBL when possible...
Message Edited by GerdW on 05-12-2009 10:02 PM
Best regards,
GerdW
CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
Kudos are welcome

Problem in writing to the file

I use this labview code to read and save some electrical measurement data from a set of instruments. I am having a problem that the code stops writing to the file after a while. It stops responding too. The only way to stop it then is to use the task manager and kill it. The code was written for an older version of labview but now I am using labview 9. Everything else seems updated but there's a section that uses Write characters to file vi and that may be causing the problem. I made a few futile attempts to change it. I would highly appreciate if someone takes a look at it and could tell me what's going wrong.
Attachments:
JANUS 2.2_4K Probe edit (2).vi ‏60 KB

I will second aeastet's advice - please look into how state machines and producer/consumer loops work and use them. Your program is very inefficient, but is very similar to what I would have written before I learned about state machines and producer/consumer loops. Start with the LabVIEW help and go from there. These forums and the National Instruments website can give you lots of help.
Two things that will help you for this particular problem:
At every loop iteration, you are opening the file, seeking to the end of it, appending data, then closing the file. This is very slow and the code you use, as mentioned above, will not work if the file size exceeds 2GBytes. I would recommend you open the file once, then use the write primitive to write to it until you finish, then close it. You do not need the write character to file VI. No seeking. No repetitive opening and closing. You can either open and close outside the loop, or use case structures and boolean flags (as you have done for other things) to open and close inside the loop.
After you write to the file, if you choose to graph, you are reopening the file, reading the entire thing, and plotting this data. This is another major slowdown that will only get worse as your file gets bigger. You would be far better off caching the data in a shift register and plotting it on demand. It would probably take less memory, as well. You may want to read the tutorial Managing Large Data Sets in LabVIEW.
One last tip. You use Value properties to read and set the values of front panel controls. Local variables are far faster (about three orders of magnitude). However, do not make the mistake of using local variables for data storage. Data is wires. Local variables are a way to communicate to the front panel. You seem to have this down, but a reminder to others reading this thread is in order.
Let us know if you need more explanation or help. Good luck!
This account is no longer active. Contact ShadesOfGray for current posts and information.

Problem in handling complex CSV file

Hi,
I am facing a strange problem in handling a complex CSV file.
The content of the file is as follows. It is getting executed through an XSD and the target is a table.
First time when the interface is executed ( for e.g session id - 19001) it is getting completed successfully.
Now when making changes in the CSV file suppose adding ( for e.g.-
DEPT,D05,Books,ABC Store
CUST,C01,Sayantan,[email protected]
CUST,C02,Shubham,[email protected])
or deleting ( for e.g.-
CUST,C02,Sarbajit,[email protected])
and running the interface I am not getting the added D05 in the target table nor my C02 data is getting removed i.e.- the updated data in CSV file is not getting fetched and I am getting the same records as i got when i ran interface of session id 19001.
I am not getting why it is happening??
The CSV file used in session id -19001 is:
DEPT,D01,Retail,World Mart
CUST,C01,Anindya,[email protected]
CUST,C02,Rashni,[email protected]
DEPT,D02,Food,Food Bazar
CUST,C01,Abhijit,[email protected]
CUST,C02,Anirban,[email protected]
CUST,C03,Sharmistha,[email protected]
DEPT,D03,Water,SW
CUST,C01,Nirmalya,[email protected]
DEPT,D04,Clothes,City style
CUST,C02,Sarbajit,[email protected]
CUST,C03,Abhishek,[email protected]

Here's what you can do to handle CSV files using HSQL.
Say the CSV file contains order data. Each order record contains data about a particular order like order number, product code, quantity, ordered by, date etc. Now lets take a hypothetical requirement which says, the user needs to know how many orders were ordered per product.
Option 1] At the basic level, read the order file, parse each line and write the logic to get count of orders per product.
Option 2] Load this CSV file into a database like MySQL and write database queries to get the orders per product.
So where does this leave us? Have we run out of options? I am sure we would have tried & used the above two options . But I wanted a different approach. Following questions were lingering in my mind:
1] Why can’t I write SQL queries against the CSV file itself. After all it’s like any RDBMS table.
2] Why should I load the CSV file into some database before I query it?
3] Why can’t I create a database table & attach the CSV file to it?
Continue Reading Here: Handling CSV Files

Proper format of cells after Writing to csv file?

I have been searching, yet struggling with what is probably pretty simple to do. I am writing data to a csv but my data is not coming out the way I need it to look in the spreadsheet once its been written. Each of the channel's data from the front panel need to be in their own Column. Please see attached csv for what I'm aiming to accomplish in a finished program. As of right now, I can write to the csv file but the data and fields are not in their proper columns/rows. Can someone get me jump started on this please? I'm very new and green in Labview. This is my first program. Thank you.
Solved!
Go to Solution.
Attachments:
Front_Panel.vi ‏23 KB
CSVdata.csv ‏1 KB

It is recommended to turn on context help (ctrl+H) so you can get a brief description of stuff you mouse over. You can get detailed information by clicking on "details".
For example, you would have seen the terminal for "transpose" in the context window. Curious to see what it did, you would have clicked on "details". That would have shown you what "transpose" does.
I hate it that Microsoft trains you to ignore help files because they write them so poorly.
Bill
(Mid-Level minion.)
My support system ensures that I don't look totally incompetent.
Proud to say that I've progressed beyond knowing just enough to be dangerous. I now know enough to know that I have no clue about anything at all.

Problem in uploading xls/csv file with Email address through oracle forms

Dear all,
I've created an interface to upload data from xls
and csv files to database tables.
I'm sucessed in this. Now i'm facing an issue.
If the xls/csv file having Email address,the
upload activity is not working..junk characters is
getting stored.
I came to know that, xls .csv file having email
address with hiperlink. so this may cause the
issue (just guessing)..
we can't restrict users to upload email without
hiperlink.. so what is the alternative to do
this..
Email address
[email protected]
[email protected]
[email protected]
etc...

Can you give some more information:
What versions of Forms, database, Java, browser are you using?
How are you uploading data? Please show us your code.
What do you mean by "email with a hyperlink"?

Problem in writing to a file

hi all ...
i am writing a simple html to a file in swing applicaiotn,the file is created but the content is not writing what may be the reason..can any one help me......
Thanks
import javax.swing.*;
import java.awt.*;
import java.awt.event.*;
import java.util.*;
import java.io.*;
import java.lang.*;
import java.sql.*;
import javax.swing.filechooser.*;
public class MyAppFrame extends JFrame implements ActionListener{
     //-- class members
     JTextField jtf_Text;
     JButton jb_Button,G_Button;
     JList j1_List;
     Vector v;
private JScrollPane jpane;
final JFileChooser fc = new JFileChooser();
MyAppFrame(String title) {
     super(title);
     setSize(600,500);
     Container contentPane = getContentPane();
     contentPane.setLayout(new BorderLayout());
          JPanel panel = new JPanel();
     panel.setLayout(new FlowLayout());
          panel.add(new JLabel("Target Folder: "));
panel.add(jtf_Text = new JTextField(10));
jb_Button=new JButton("List");
jb_Button.addActionListener(this);
panel.add(jb_Button);
G_Button=new JButton("Generate");
panel.add(G_Button);
G_Button.addActionListener(this);
contentPane.add(panel,BorderLayout.NORTH);
panel = new JPanel();
          panel.setLayout(new GridLayout(2,1));
          panel.add(new JLabel("Selected Forms:"));
v=new Vector();
panel.add(j1_List = new JList());
//j1_List.setEnabled(false);
jpane = new JScrollPane();
jpane.getViewport().add(j1_List);
contentPane.add(panel, BorderLayout.CENTER);
panel.add(jpane);
          addWindowListener(new ExitListener());
     setVisible(true);
     public static void main(String[] args) {
     MyAppFrame maf = new MyAppFrame("Form Selection");
class ExitListener extends WindowAdapter{
public void windowClosing(WindowEvent event) {
System.exit(0);
private void con(){
          Connection con=null;
     ResultSet rs=null;
     try{
     Class.forName("sun.jdbc.odbc.JdbcOdbcDriver");
     con = DriverManager.getConnection("jdbc:odbc:satya");
     System.out.println("Set Connection");
     Statement st=con.createStatement();
     String query="select form_name from form";
     System.out.println(query);
rs=st.executeQuery(query);
while(rs.next()){
          String name = rs.getString("form_name");
          //JLabel l=new JLabel(name);
          //j1_List.add(l);
          v.add(name);
          // System.out.println(name);
               j1_List.setListData(v);
               catch(Exception e)
e.printStackTrace();
public void actionPerformed(ActionEvent e) {
String flag = e.getActionCommand();
if(flag.equals("List")){
this.con();
else
     StringBuffer sb = new StringBuffer();
     sb.append("<html><h1>Hai</h1></html>");
     String formname=(String)j1_List.getSelectedValue();
     String Dir=jtf_Text.getText();
     Dir +="\\0ne.txt";
     if(formname!=null && Dir !=null)
     try
     PrintWriter out= new PrintWriter(new FileWriter(Dir));
//BufferedWriter br=new BufferedWriter(out);
     out.println(sb);
catch(Exception e1)
System.out.println(e1);
     //jb_Button.setEnabled(false);
//jb_Button.addActionListener(this);
//StringBuffer Sb = new StringBuffer();

http://forum.java.sun.com/thread.jsp?forum=57&thread=299655

Problem in writing data in file......

i am having problem in passing a String object path ;
taken from user in following way
FileWriter fw = new FileWriter(path,append);
error is : (The filename, directory name, or volume label syntax is incorrect)
but if i am using
FileWriter fw = new FileWriter("f.txt",append);
it works...
but i want filename from user... how to achieve this

class writeData
     public String getName()
                    String name=null;
     try
          char c;
          StringBuffer bf=new StringBuffer();
          System.out.print("Enter the File Name:- ");
          while((c=(char)System.in.read())!='\n')
               bf.append(c);
          name=bf.toString();
          catch(Exception e)
          System.out.println("Error is:-"+e);
          return name;
public void wfile(String name1)
          try
          String path ="D:/fname.txt";
          boolean append = true;
          FileWriter fw=new FileWriter(path); // its not working....
          //FileWriter fw=new FileWriter("D:/fname.txt");
          catch(Exception e)
               System.out.println("Error is :- "+e);
public class bravo
     public static void main(String args[])
          writeData wd = new writeData();
          String n = wd.getName();
          wd.wfile(n);
}

Problem while writing in a file

Hi,
i want to write some bytes in a file but it is producing an error
error:
====
java.io.FileNotFoundException: C:\Documents and Settings\rrus\My Documents\data.pkcs7data (The system cannot find the path specified)
code:
====
File obj_file = new File(System.getProperty("user.home")+"/My Documents/Signature.sig");
if(!obj_file.exists())
obj_file.createNewFile();
FileOutputStream obj_fout = new FileOutputStream(obj_file);
obj_fout.write(m_bData); // m_bData is byte array
obj_fout.flush();
obj_fout.close();

And:
C:\Documents and Settings\rrus\My Documents\data.pkcs7data
File obj_file = new File(System.getProperty("user.home")+"/My Documents/Signature.sig");Something doesn't quite match here. Your eror message does not match your code.

Problem with writing into txt file on the Web

Hello friends - please could you give me an advice? Java console says:
Exception in thread "AWT-EventQueue-2" java.security.AccessControlException: access denied (java.io.FilePermission http:\web.telecom.cz\jiriczech\xanado.txt write)
Thank you a lot in advance:)!!

The place you are trying to write the file to does not have write permission.

Writing ouput to the next column in a .csv file

I am Writing to .CSV file with PL/SQL code:
CREATE OR REPLACE PROCEDURE Write_File(p_name IN VARCHAR)
AS
BEGIN
DECLARE
CURSOR emp_sel IS SELECT ename,hiredate FROM EMP;
file_name VARCHAR2(20);
output_file utl_file.file_type;
BEGIN
file_name:= (p_name||'.csv');
output_file:=utl_file.fopen('d:\test_dir',p_name||'.csv','W');
FOR i IN emp_sel LOOP
utl_file.put_line(output_file,'NAME:'||i.ename);
utl_file.put_line(output_file,'hire Date:'||i.hiredate);
END LOOP;
utl_file.fclose(output_file);
EXCEPTION
WHEN OTHERS THEN
dbms_output.put_line(SQLCODE||SQLERRM);
END;
END;
Just wanted to know how Move to the next Column in the .csv file.
at present the ename and hiredate r written in the 1st Column C1 column.
I want to write the hiredate data in C2 column.
how to?

user545846,
I answered you in the other thread:
Re: Calling utl_file package from a java program
Good Luck,
Avi.

Output CSV file problem

Hi Guru,
I encounted 1 problem where my output csv file content incorrect. Source is from SAP Proxy.
Example my csv file should have Material code, material description and date. However when i open the csv file, it is only have material code in one line and the rest of fields are not display in the csv file.
<?xml version="1.0" encoding="UTF-8"?>
<ns0:MT_PRD_MASTER_SND xmlns:ns0="http://com.starhub/sapprdcat">
   <RECORDSET>    1:1
      <RECORD>       1:unbounded
         <MATNR/>
         <MAKTX/>
         <DATE_ADD/>
      </RECORD>
   </RECORDSET>
</ns0:MT_PRD_MASTER_SND>
My source and target are same.
CC Receiver setting:
Transport Protocal : File System NFS
Message Protocal : File Content Conversion
Adapter Engine : Integration Server
Recordset Structure : RECORD
RECORD.fiedlNames : MATNR,MAKTX,DATE_ADD
RECORD.endSeparator : 'nl'
RECORD.fieldSeparator : ,
RECORD.processFieldNames: fromConfiguration
RECORD.addHeaderLine: 0
The INCORRECT result only display MATNR in one line only.
HNOK0000102     HNOK0000108     C032S31384A     C032S3XDATA     CFGSC300300     CRAWC300001
Expected Result should be :
HNOK0000102,Material test 1,01/01/2007
HNOK0000108,Material test 2,01/02/2007
C032S31384A,Material test 3,01/01/2007
C032S3XDATA,Material test 4,01/01/2007
CFGSC300300,Material test 5,01/01/2007
CRAWC300001,Material test 6,01/01/2007
Thank you very much for help.
Regards,

hi,
check this parameter:
Recordset Structure : RECORD [wrong]
Recordset Structure : RECORDSET,RECORD [right]
and the other parameters will be like this:
RECORD.fiedlNames : MATNR,MAKTX,DATE_ADD
RECORD.endSeparator : 'nl'
RECORD.fieldSeparator : ,
RECORD.processFieldNames: fromConfiguration
RECORD.addHeaderLine: 0
<b>RECORDSET.fieldSeparator: 'nl'</b>
Sachin
Message was edited by:
        Sachin Dhingra

Writing in INF file Problem!

Hi
I've successfully read from INF file by the following code :
    public String Read_INI(String Path , String Attribute)
        Properties p = new Properties();
        try
            p.load(new FileInputStream(Path));
        catch (Exception e)
                System.out.println(e);
        return p.getProperty(Attribute);
    }Now I'm facing a problem in writing in INF file
i used this code but it doesn't work!
    public void Write_INI(String Value, String Attribute, String Path)
        Properties p = new Properties();
        try
               p.load(new FileInputStream(Path));
               p.setProperty(Attribute, Value);
        catch (Exception e)
                System.out.println(e);
    }any ideas ?

thnx very much :)
just i added :
               p.store(new FileOutputStream(Path), Value);after :
     p.setProperty(Attribute, Value);

How to write the char value as is in the CSV file

Hi Everyone,
I am creating csv files which contains inventory details for all the products. I am able to create the csv file with utl file concepts. My problem starts after the csv file is being created.
some of the product numbers(Though I am saying Product number, it is varchar2 data type in the table) is like this 3E-12, 3E-54 and so on. I have totally 23 product numbers like this.
When the user opens the csv file it is changing to numbers like this 3.00E-12, 3.00E-54. I want to keep the product number as it is like char value. I tried many quoting and concat methods.
But none of them works for me.
I am using oracle 9i.
Oracle9i Enterprise Edition Release 9.2.0.7.0 - Production
With the Partitioning, OLAP and Oracle Data Mining options
JServer Release 9.2.0.7.0 - Production
Please help me to solve this problem.
Thanks in advance,
Vimal...

Hi Friends,
Thanks for the immediate response. Here is my code.
CREATE OR REPLACE PROCEDURE DATA_TO_CSV_FILE
IS
l_file_ptr UTL_FILE.file_type;
l_hdr_text VARCHAR2 (4000);
l_dynamic_sql_str VARCHAR2 (4000);
TYPE l_dynamic_sql IS REF CURSOR;
l_dynamic_cursor l_dynamic_sql;
l_org_id_select VARCHAR2 (200);
l_master_org_id NUMBER;
l_category VARCHAR2 (40);
l_itemno VARCHAR2 (40);
l_description VARCHAR2 (240);
l_brand VARCHAR2 (240);
l_organization_id NUMBER;
l_oh NUMBER;
l_status apps.mtl_system_items.inventory_item_status_code%TYPE;
BEGIN
l_file_ptr := UTL_FILE.fopen ('CSV_DIR', 'inventory.csv', 'w');
l_dynamic_sql_str :=
'SELECT mc.segment2 CATEGORY, itm.segment1 itemno '
|| 'itm.description description, LOG.brand brand,'
|| 'NVL (m.oh, 0) oh'
|| '(select msi.inventory_item_status_code from apps.mtl_system_items msi'
|| ' where msi.inventory_item_id = itm.inventory_item_id'
|| ' and msi.organization_id = '
|| l_master_org_id
|| ' ) status '
|| ' FROM xxx_custom_table m,'
|| ' apps.mtl_item_categories ic,'
|| ' apps.mtl_categories_b mc,'
|| ' apps.mtl_system_items itm,'
|| ' xxx_custom_table1 LOG,'
|| ' xxx_custom_table2 cap'
|| ' WHERE m.item_id(+) = itm.inventory_item_id'
|| ' AND m.org_id(+) = itm.organization_id'
|| ' AND itm.segment1 = cap.itemno(+)'
|| ' AND itm.inventory_item_id = ic.inventory_item_id'
|| ' AND itm.organization_id = ic.organization_id'
|| ' AND ic.category_id = mc.category_id'
|| ' AND mc.segment2 IS NOT NULL'
|| ' AND itm.inventory_item_id = LOG.inventory_item_id'
|| l_org_id_select
|| ' GROUP BY mc.segment2,'
|| ' itm.segment1,itm.inventory_item_id,itm.description,'
|| ' LOG.brand,LOG';
OPEN l_dynamic_cursor FOR l_dynamic_sql_str;
LOOP
FETCH l_dynamic_cursor
INTO
l_category, l_itemno, l_description, l_brand, l_status,l_oh;
EXIT WHEN l_dynamic_cursor%NOTFOUND;
UTL_FILE.put_line (
l_file_ptr,
l_CATEGORY
|| ','
|| l_itemno
|| ','
|| l_description
|| ','
|| l_status
|| ','
|| l_brand
|| ','
|| l_oh
END LOOP;
UTL_FILE.fclose (l_file_ptr);
END;
Hey damorgan,
Can you please give me little more detail about your workaround method. I think I did the ODBC Connection Once for MS ACCESS database. I
hope you are taking about the same method.
Thanks
Vimal....

Read a csv file in a PL/SQL routine with the path as a parameter

hello oracle community,
System Windows 2008, Oracle 11.1 Database
I have created a directory in the database and there is no problem to read a csv file from there. Since the files can be at different places, my java developer is asking me, if he can give me the path of the file as a parameter. So far I know I will need a directory to open the file with the UTL_FILE package, but I cannot create diretories for folders, that will be created in the future. Is there any way to solve that problem, so I can use the path as a parameter in my routine ?
Ikrischer

BluShadow wrote:
Ikrischer wrote:
as I said before, they are dynamic. As usal to most other companies, you get new partners and you will lose partners, so new folders will be added, old ones will be deleted. if you use different directories for different folders, you have more work to handle them.I wouldn't call that dynamic, I would call that business maintenance. Dynamic would mean that the same company is putting their files into different folders each time or on a regular basis. If it's one folder per company then that's not dynamic.the folder structure is changing, I call that dynamic, does not look static to me. but thats just a point of view, it is not important how we call it. lets just agree, the folder structure will change in the future, no matter how many folders one partner will have.
BluShadow wrote:
So you're receiving files and you don't even know the format of them? Some of them are not "correct"? Specify that the company must provide the files in the correct format or they will be rejected.
Computers work on known logic in most cases, not some random guessing game.we know the correct format, but we also know, that the partner wont always send the correct format, period. Cause of that we want to deliver an error log, record 11,15 and 20 is wrong cause of....that is a very usefull service.
BluShadow wrote:
The folders should be known.impossible, we do not know the future.
BluShadow wrote:
The file format should be known.see above, it has a fixed format, but thats not a gurantee you get the correct format. for me thats a normal situation, it happens every day, you have fixed rules and they will be broken.
BluShadow wrote:
The moment you allow external forces to start specifying things how they want it then you're shooting yourself in the foot. That's not good design and not good business practice.maybe we are talking about different things, we do not allow to load data into our system with a wrong format. but we do allow to to send us a wrong format, and even more, we do allow them to send wrong content, but still we dont load it into our system. format and content must be correct to be loaded in the real system, but both we are checking. and with external tables you cannot check a wrong format we a detailed error log.
Ikrischer

Problem in writing to CSV file

Similar Messages

Maybe you are looking for