How to query a csv file
Hello I am new to cold fusion.
I am wondering if there is a way to query a csv file using a read from cffile? Currently I have it setup as a cffile read and then I try to query the file using cffquery. Obviously this doesn't work because I have to set a datasource. Is there anyway to do this or any way to set a csv file as a data source? Any help or direction would be greatly appreciated.
Thanks.
You would have to read in the csv and create a query using QueryNew(). Once you have the csv in a query format, then you can perform query of queries to do most anything you want on the data. There is probably code already written out there to do the csv to query, you just need to find it. The query of queries is in the documentation. The only gotcha is that query of queries sorting and matching is case sensitive. Hope this helps.
Similar Messages
-
How to query the flat files?
Hi
How to query the flat files that are used in Etl From EBS source.That can be done in OBIEE. Save the flat file as .csv format. Then go to ODBC Administrator on windows machine where you BI server is running, and create an System DSN and select "Microsft Access Text Driver (*.txt, *.csv)" as driver type.
Next, import tables in RPD using this ODBC connection. Rest of the steps as same as building model from a table source.
Hope this helps. -
How to create a CSV file in java
how to create a CSV file in java
this is the code that I have used in a hp project:
private static final String DELIMIT = ",";
StringBuffer buf = new StringBuffer();
public void addString(String str){
buf.append(toEscapedStringLiteral(str.replaceAll(" ","").trim())).append(DELIMIT);
public void sendFile( String strData ,
String strTitle,
String strContType,
HttpServletResponse res ) throws IOException {
byte[] _filedata=strData.getBytes();
res.setContentType( strContType );
res.setHeader( "Content-Disposition", "attachment;filename="+ strTitle );
DataOutputStream out = new DataOutputStream( res.getOutputStream() );
out.write( _filedata, 0, _filedata.length );
out.close();
public void addStringWhithReturn(String str){
buf.append(toEscapedStringLiteral(str.replaceAll(" ","").trim()));
buf.append( "\n" );
private String toEscapedStringLiteral( String charSeq ) {
if ( null == charSeq ) {
charSeq = "";
return "\"" + charSeq + "\"";
....hope its help
kou -
How to create a csv file with NCS attributes?
Hi
i installed Cisco Prime NCS and trying to perform bulk update of device credentials with csv file.
How to create a csv file with all required attributes?
This is part of NCS online help talking about this topic:
Bulk Update Devices—To update the device credentials in a bulk, select Bulk Update Devices from the Select a command drop-down list. The Bulk Update Devices page appears.You can choose a CSV file.
Note The CSV file contains a list of devices to be updated, one device per line. Each line is a comma separated list of device attributes. The first line describes the attributes included. The IP address attribute is mandatory.
Bellow is test csv file i created but does not work:
10.64.160.31,v2c,2,10,snmpcomm,ssh,zeus,password,password,enablepwd,enablepwd,60
10.64.160.31,v2c,2,10,snmpcomm,ssh,zeus,password,password,enablepwd,enablepwd,60
The error i am getting while importing this file:
Missing mandatory field [ip_address] on header line:10.64.160.31,v2c,2,10,snmpcomm,ssh,zeus,password,password,enablepwd,enablepwd,60
Assistance appreciated.It looks like the IP address field is incorrectly set.,
It should be as follows
{Device IP},{Device Subnet Mask}, etc etc
so a practical example of the aboove could be (i dont know if this is completely correct after the IP address / Subnet Mask)
10.64.160.31,255.255.255.0,v2c,2,10,snmpcomm,ssh,zeus,password,password,enablepwd,enablepwd,60
below is a link to the documentation
http://www.cisco.com/en/US/docs/wireless/ncs/1.0/configuration/guide/ctrlcfg.html#wp1840245
HTH
Darren -
How to write a CSV file in OSB
Hi All,
can any one tell me How to write a CSV file in OSB?
Thanks.Hey, I couldnot find any xsl usage inside pipeline pair in the links given by you. Do you have any links that gives a sample example.I could not find any links with examples. I will send you a simple config jar demonstrating the use of XSLT resources/transformations.
secondly should MFL doc replicate the name(s)of the nodes of the source xsd:I'm not sure If I understood your question.Can you please explain?
Ex: My database schema looks like:
<?xml version = '1.0' encoding = 'UTF-8'?>
<xs:schema targetNamespace="http://xmlns.oracle.com/pcbpel/adapter/db/top/AssetsPoll" xmlns="http://xmlns.oracle.com/pcbpel/adapter/db/top/AssetsPoll" elementFormDefault="qualified" attributeFormDefault="qualified" xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="CountriesCollection" type="CountriesCollection"/>
<xs:complexType name="CountriesCollection">
<xs:sequence>
<xs:element name="Countries" type="Countries" minOccurs="0" maxOccurs="unbounded"/>
</xs:sequence>
</xs:complexType>
<xs:complexType name="Countries">
<xs:sequence>
<xs:element name="countryId">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:maxLength value="2"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="countryName" minOccurs="0" nillable="true">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:maxLength value="40"/>
</xs:restriction>
</xs:simpleType>
</xs:element>
<xs:element name="regionId" type="xs:decimal" minOccurs="0" nillable="true"/>
</xs:sequence>
</xs:complexType>
</xs:schema>
and the corresponding MFL that I have created gives this output
<?xml version="1.0" encoding="windows-1252"?>
<countriesCollection1>
<Countries>
<counrtyId>counrtyId</counrtyId>
<country_name>country_name</country_name>
<regionId>regionId</regionId>
</Countries>
<Countries>
<counrtyId>counrtyId</counrtyId>
<country_name>country_name</country_name>
<regionId>regionId</regionId>
</Countries>
</countriesCollection1>
Why I am asking this beacuse there is an error that i am getting:
Jun 19, 2009 5:50:50 PM IST> <Error> <JCATransport> <BEA-381951> <JCA inbound r
quest only invocation failed, exception: java.security.PrivilegedActionExceptio
: com.bea.wli.sb.transports.TransportException: Binary to XML mfl transformatio
failed for the MFL Resource Database-Jms-File/Database-File/MFLSample : null
ava.security.PrivilegedActionException: com.bea.wli.sb.transports.TransportExce
tion: Binary to XML mfl transformation failed for the MFL Resource Database-Jms
File/Database-File/MFLSample : null..................................................
Any help?
Regards
PS -
How to import an .csv file into the database?
and can we code the program in JSP to import the.csv file into the database.
It is better to use Java class to read the CSV file and store the contents in the database.
You can use JSP to upload the CSV file to the server if you want, but don't use it to perform database operations.
JSPs are good for displaying information on the front-end, and for displaying HTML forms, there are other technologies more suitable for the middle layer, back end and the database layer.
So break you application into
1) Front end - JSPs to display input html forms and to display data retrieved from the database.
2) Middle layer - Servlets and JavaBeans to interact with JSPs. The code that reads the CSV file to parse it's contents should be a Java Class in the middle layer. It makes use of Java File I/O
3) Database layer - Connects to the database using JDBC (Java Database Connectivity), and then writes to the database with SQL insert statements.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Keeping the above concepts in mind, first build a simple JSP and get it to work,
then research on Google , for Java File I/O , discover how to read a file,
Then search on how to readh a CSV file using Java.
After researching you should be able to read the CSV file line by line and store each line inside a Collection.
Then research on Google, on how to write to the database using JDBC
Write a simple program that inserts something to a dummy table in the database.
Then, read the data stored in the Collection, and write insert statements for each records in the collection. -
VISA: How to get the CSV file through C/C++ code?
How to get the CSV file through C/C++ code?
I'm communicating with a USB oscilloscope using VISA.Thank you for your reply.
I am using Apache Commons File Upload. Here is the code where I got the "fi".
DiskFileUpload fu = new DiskFileUpload();
fu.setSizeMax(1000000000);
List fileItems = fu.parseRequest(request);
Iterator itr = fileItems.iterator();
FileItem fi = (FileItem)itr.next();
if(!fi.isFormField())
File tempFileRef = new File(fi.getName());
System.out.println("Field = "+tempFileRef.getAbsolutePath());
} -
How to load 100 CSV file to DSO / InfoCube
Hi
How to load 100 CSV files of transcational data to DSO / InfoCube?Hi,
you can achieve to write the .bat (batch file program in windows)
.bat program it will convert to xsl to .CSV format.
in process chain you can use the OS COMMAND option while creating process chain.
it will first trigger the bat file then it will trigger the excel files and info package.
now i am also working on same scenario now.
please find the below doc how to create the process chain using os command.
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/e0c41c52-2638-2e10-0b89-ffa4e2f10ac0?QuickLink=index&…
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/3034bf3d-9dc4-2d10-9e93-d4ba01505ed9?QuickLink=index&…
Thanks,
Phani. -
How to use a .csv file as a database ?
Hi everyone,
I have a .csv file and I need to update some values in a column based on some condition. Basically I want to use the .csv file as a database such that I can perform query on it and update the result set as required.
I am having trouble using csvjdbc though, can anyone give me a simple example about how to build a new database and import the csv file into it? Many thanks!!
By the way, I tried a small program which was found online:
import java.sql.*;
public class test {
public static void main(String args[]) throws Exception{
Class.forName("org.relique.jdbc.csv.CsvDriver");
System.out.println("I'm ok!");
But I got an exception as following:
Exception in thread "main" java.lang.ClassNotFoundException: org.relique.jdbc.csv.CsvDriver
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:164)
at test.main(test.java:5)
Could anyone tell me how to fix it? Thanks.
ArjinIt's because Class.forName will throw ClassNotFoundException if it cannot locate the class file. You need to set classpath so that org.relique.jdbc.csv.CsvDriver class can be located by ur code.
-
Need help with query from .csv file
I am trying to import a csv file with only 1 column in it.
The column will only contain a 9 digit ID number. I want to read
the file then use the contents to query a table to get the names
and other information and display it. Here is what I have so far:
<cffile action="read" file="#form.FiletoUpload#"
variable="csvfile">
<cfloop index="index" list="#csvfile#">
<cfquery name="massimport" datasource="data1">
SELECT * FROM IDTable
WHERE CardNumber = ('#csvfile#')
</cfquery>
</cfloop>
<cfoutput>#Name# #ID# #Site#</cfoutput>
I get no errors but I am not getting any results. Just a
blank page. Does anyone know how to query directly from a csv
import? Thanks.You need to convert your file to a list somehow. Not sure if
this is the most efficient way but, you can use the cfhttp tag to
produce a query. Then your where clause becomes,
where cardnumber in (#quotedvaluelist(query.column)#)
and you won't need a loop. -
Saving result from query into CSV file
Hi folks,
in our application we're generating pages source using general packages (like htp, owa_util, ...). and in this part I'm a really beginner.
I want to modify source one of our page, I want to add functionality to enable save result from query (cursor) into CSV file, to enable user choose place where generated file will be created and also change file name.
I searched this forum and I found procedure, that could be useful:
procedure p_getcsv is
cursor cur is
select 'a1' col1, 'b1' col2, 'c1' col3 from dual
union select 'a2' col1, 'b2' col2, 'c2' col3 from dual
union select 'a3' col1, 'b3' col2, 'c3' col3 from dual;
begin
-- Set the MIME type
owa_util.mime_header( 'application/octet', FALSE );
-- Set the name of the file
htp.p('Content-Disposition: attachment; filename="test.csv"');
-- Close the HTTP Header
owa_util.http_header_close;
-- Loop through all rows in EMP
for x in cur
loop
-- Print out a portion of a row,
-- separated by commas and ended by a CR
htp.prn(x.col1||','|| x.col2||','||x.col3|| chr(13));
end loop;
end;What peace of code should I add to procedure that is generating web page to enable calling this procedure and whole saving process?
Can anybody help me with this?
Many thanks,
Tomas
Message was edited by:
TomeoHi Marc,
thanks for reply, problem is that I'm not using APEX application, I'm just generating web page code straight using oracle general packages.
But I found this solution (maybe some tunning will be good):
In page where I want to display Download i have
begin
htp.anchor2 (
curl => ... .p_getcsv'||'?term=2005&crn=123,
ctext => 'Download Class List'
HTP.br;
end;
...si I'm calling p_getcsv procedure:
procedure p_getcsv( term IN stvterm.stvterm_code%TYPE DEFAULT NULL,
crn IN sirasgn.sirasgn_crn%TYPE DEFAULT NULL) is
v_length NUMBER;
v_file_name VARCHAR2 (2000);
temp_blob blob;
line RAW(32767);
begin
DBMS_LOB.CREATETEMPORARY(temp_blob, TRUE);
FOR i IN 1..6 LOOP
line := UTL_RAW.CAST_TO_RAW(i||','||term||','||crn||',AAA,BBB,CCC'||chr(10));
DBMS_LOB.WRITEAPPEND(temp_blob, LENGTH(UTL_RAW.CAST_TO_VARCHAR2(line)), line);
END LOOP;
v_file_name := 'ClassList.csv';
v_length := DBMS_LOB.getlength (temp_blob);
-- set up HTTP header
-- use an NVL around the mime type and
-- if it is a null set it to application/octect
-- application/octect may launch a download window from windows
OWA_UTIL.mime_header (NVL ('csv', 'application/octet'), FALSE);
-- set the size so the browser knows how much to download
HTP.p ('Content-length: ' || v_length);
-- the filename will be used by the browser if the users does a save as
HTP.p ( 'Content-Disposition: attachment; filename="'
|| REPLACE (REPLACE (SUBSTR (v_file_name,
INSTR (v_file_name, '/') + 1
CHR (10),
NULL
CHR (13),
NULL
|| '"'
-- close the headers
OWA_UTIL.http_header_close;
-- download the BLOB
WPG_DOCLOAD.download_file (temp_blob);
-- release temporary blob
dbms_lob.freetemporary(temp_blob);
end;Regards,
Tomas -
I am almost new to Oracle, been a decade since I last worked on it. I have query over multiple tables. I need to run the query daily and get a csv file out of it. How sure how to do it. Can anyone please help? In the csv file I need no headers etc. just comma separated rows.
I found this link which is very helpful, however, no matter what I try, the output file shows the query too. How do I make sure the output file has just the data and not the query?
http://stackoverflow.com/questions/643137/how-do-i-spool-to-a-csv-formatted-file-using-sqlplus
Edited by: 857833 on May 10, 2011 9:00 AMThis is getting very frustrating. Below is what I type in my sql plus window.
set colsep ','
set echo off
set feedback off
set linesize 1000
set pagesize 0
set sqlprompt ''
set trimspool on
set headsep off
spool "FULLPATHTOOUTPUTFILE"
@"FILEWITHQUERY.SQL"
spool off
This creates the output file, where first line is @"FILEWITHQUERY.SQL"
then shows the result set rows, the last row in the file is "spool off"
Can you please show me an example that works for you? I never imagined generating a text file from tables is this hard. :(( -
How do I import csv file into a SharePoint list?
I am trying to use a PowerShell script to load data into a SharePoint list from a csv file. When I run my code, it seems to go through the process of loading the data into the list. However when I go to my list, all I see is "System.Object[]" displayed
in the first column of all my rows with no other data displayed. When I check my csv file, I see a ton of data (several rows and columns) but that is not being moved to my SharePoint list. This is what my script looks like
if((Get-PSSnapin | Where {$_.Name -eq “Microsoft.SharePoint.PowerShell”}) -eq $null) {
Add-PSSnapin Microsoft.SharePoint.PowerShell
$web = Get-SPWeb http://link to web
$list = $web.lists["List Name"]
$recordsNumber = 0
foreach($i in Import-CSV myCSVFile.csv)
$new = $list.Items.Add()
$new["Title"] = $i.Title,
$new["FirstName"] = $i.FirstName,
$new["LastName"] = $i.LastName
$new.Update()
$recordsNumber++
"Added " + $recordsNumber.ToString() + " records."
"Done. Press any key to continue..."
$null = $Host.UI.RawUI.ReadKey("NoEcho,IncludeKeyDown")
Any ideas on how to fix this, and get my list populated with data?if ( (Get-PSSnapin -Name Microsoft.SharePoint.PowerShell -ErrorAction SilentlyContinue) -eq $null )
Add-PsSnapin Microsoft.SharePoint.PowerShell
$host.Runspace.ThreadOptions = "ReuseThread"
#Open SharePoint List
$SPServer=http://SOMESERVER
$SPAppList="/Lists/List Name/"
$spWeb = Get-SPWeb $SPServer
$spData = $spWeb.GetList($SPAppList)
$InvFile="myCSVFile.csv"
# Get Data from Inventory CSV File
$FileExists = (Test-Path $InvFile -PathType Leaf)
if ($FileExists) {
"Loading $InvFile for processing..."
$tblData = Import-CSV $InvFile
} else {
"$InvFile not found - stopping import!"
exit
# Loop through Applications add each one to SharePoint
"Uploading data to SharePoint...."
foreach ($row in $tblData)
"Adding entry for "+$row."Application Name".ToString()
$spItem = $spData.AddItem()
$spItem["Title"] = $row."Title".ToString()
$spItem["FirstName"] = $row."FirstName".ToString()
$spItem["LastName"] = $row."LastName".ToString()
$spItem.Update()
"Upload Complete"
$spWeb.Dispose()
Link
Please 'propose as answer' if it helped you, also 'vote helpful' if you like this reply. -
How to add a CSV file to a desktop application and access it?
I'm writing a desktop application for looking up phone numbers (this numbers are stored in a .CSV file). Where should I put the file in the project and how to access it? I intend to put it in the project and open it in a buffered reader!
Thanks!The best place to put application data is probably user.home, as described in the [Store Application Settings and Components|http://sdnshare.sun.com/view.jsp?id=2305] post at SDNShare.
If those listings are still messed up, try these alternate renderings of [AppStore.java|http://pscode.org/fmt/sbx.html?url=/test%2FAppStore.java&col=2&fnt=2&tab=2&ln=0] & [AppStoreDemo.java|http://pscode.org/fmt/sbx.html?url=/test%2FAppStoreDemo.java&col=2&fnt=2&tab=2&ln=0]. -
How to read/write .CSV file into CLOB column in a table of Oracle 10g
I have a requirement which is nothing but a table has two column
create table emp_data (empid number, report clob)
Here REPORT column is CLOB data type which used to load the data from the .csv file.
The requirement here is
1) How to load data from .CSV file into CLOB column along with empid using DBMS_lob utility
2) How to read report columns which should return all the columns present in the .CSV file (dynamically because every csv file may have different number of columns) along with the primariy key empid).
eg: empid report_field1 report_field2
1 x y
Any help would be appreciated.If I understand you right, you want each row in your table to contain an emp_id and the complete text of a multi-record .csv file.
It's not clear how you relate emp_id to the appropriate file to be read. Is the emp_id stored in the csv file?
To read the file, you can use functions from [UTL_FILE|http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14258/u_file.htm#BABGGEDF] (as long as the file is in a directory accessible to the Oracle server):
declare
lt_report_clob CLOB;
l_max_line_length integer := 1024; -- set as high as the longest line in your file
l_infile UTL_FILE.file_type;
l_buffer varchar2(1024);
l_emp_id report_table.emp_id%type := 123; -- not clear where emp_id comes from
l_filename varchar2(200) := 'my_file_name.csv'; -- get this from somewhere
begin
-- open the file; we assume an Oracle directory has already been created
l_infile := utl_file.fopen('CSV_DIRECTORY', l_filename, 'r', l_max_line_length);
-- initialise the empty clob
dbms_lob.createtemporary(lt_report_clob, TRUE, DBMS_LOB.session);
loop
begin
utl_file.get_line(l_infile, l_buffer);
dbms_lob.append(lt_report_clob, l_buffer);
exception
when no_data_found then
exit;
end;
end loop;
insert into report_table (emp_id, report)
values (l_emp_id, lt_report_clob);
-- free the temporary lob
dbms_lob.freetemporary(lt_report_clob);
-- close the file
UTL_FILE.fclose(l_infile);
end;This simple line-by-line approach is easy to understand, and gives you an opportunity (if you want) to take each line in the file and transform it (for example, you could transform it into a nested table, or into XML). However it can be rather slow if there are many records in the csv file - the lob_append operation is not particularly efficient. I was able to improve the efficiency by caching the lines in a VARCHAR2 up to a maximum cache size, and only then appending to the LOB - see [three posts on my blog|http://preferisco.blogspot.com/search/label/lob].
There is at least one other possibility:
- you could use [DBMS_LOB.loadclobfromfile|http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14258/d_lob.htm#i998978]. I've not tried this before myself, but I think the procedure is described [here in the 9i docs|http://download.oracle.com/docs/cd/B10501_01/appdev.920/a96591/adl12bfl.htm#879711]. This is likely to be faster than UTL_FILE (because it is all happening in the underlying DBMS_LOB package, possibly in a native way).
That's all for now. I haven't yet answered your question on how to report data back out of the CLOB. I would like to know how you associate employees with files; what happens if there is > 1 file per employee, etc.
HTH
Regards Nigel
Edited by: nthomas on Mar 2, 2009 11:22 AM - don't forget to fclose the file...
Maybe you are looking for
-
BCM4318 Cannot get to work on Acer Aspire 5100
Ok so I just installed Arch on my Aspire 5100 and it has a PCI BCM4318 Wireless LAN card. I cannot get it to work or find networks with ndiswrapper or anything. I am using gnome and it keeps telling me I don't have the firmware installed when I fol
-
How do I stream the dvd's I insert into my mac on my apple tv?
How do I stream the dvd's I insert into my mac on my apple tv?
-
Line-logging and protected text on custom control, protect_lines
I have a module pool with various screens which contain texts. Because of other requirements, it was necessary to create custom controls which show those texts as a sort of preview pane, that it, a white box which shows the text and allows one to en
-
"Invalid iPhoto library" reported with import attempts?
I get this: "importing libraries from versions earlier than iPhoto 7.1.5 is not supported Please upgrade your iPhoto library with iPhoto 7.1.5 or later." when I attempt to import from iPhoto 11 9.1 into Aperture 3? I pressed option/command and rebuil
-
How to sync ipod in with my wifes acct and get my music
My mini has 2 accounts: mine and my wifes. Both accounts have their own iTunes Music libraries. Our iPod Touch is always synced to my wife's account. When I open iTunes in my wife's account I see my library and can play music from my library. Howeve