How to remove quotations marks from csv file

Hi
My input file is a .csv file which contains each value in quotation marks
ex: - "123456778","jakob","grade10"
Also each record in the input file contains 333 values .
i am reading these records and using stringtokenizer to fetch value by value for that record .
i want to remove the quotation marks before i put the values back into an output file with .txt extension .
those output files will be bcped later into sybase db.
Should the quotation marks be removed in the java code or is their anyother way to remove the quotation marks from the output file while bcping them .
Thank You

njb7ty wrote:
I also suggest if possible, you use tab delimited cvs files rather than comma delimited cvs files.That would be TSV, LOL...
If there are commas inside your data elements, you will not be able to tell if they are part of the data or are delimiters. Tab delimited files avoid this.What if your data contain tabs? Although there's no CSV specification, the common standard practice is to use two double quotes to escape a quote.

Similar Messages

How to remove HTML encoding from csv file using powershell

Hi guys i am exporting data from a sharepoint list using powershell which works fine. My problem is that some of the fields contain HTML mark up. Is there a way to remove all of the html mark up from the array before writing it to csv ?
I have tried playing about with System.Web.HttpUtility.HtmlDecode but with no luck the code runs but no html is removed.
Below is a sample of my script.
Set-Variable HOME $env:USERPROFILE -Force
(Get-PSProvider FileSystem).Home = $HOME
if(-not(Get-PSSnapin | where { $_.Name -eq "Microsoft.SharePoint.PowerShell"}))
Add-PSSnapin Microsoft.SharePoint.PowerShell;
# imports assembly needed for url stuff to do
Add-Type -AssemblyName System.Web
$SPWeb = Get-SPWeb "http://site url"
$SPList = $SPWeb.Lists["List Name"]
$exportlist = @()
$SPList.Items | foreach {
$obj = New-Object PSObject -Property @{
"Employee full name" = $_["EMPLOYEEFNAME"]
"Employee login name" = $_["EMPLOYEENAME"]
"Department Name" = $_["DEPARTMENT"]
System.Web.HttpUtility.HtmlDecode("OBJECTIVESTOBEACHIEVED_0") = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_0"]
"OBJECTIVESTOBEACHIEVED_1" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_1"]
"OBJECTIVESTOBEACHIEVED_2" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_2"]
"OBJECTIVESTOBEACHIEVED_3" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_3"]
"OBJECTIVESTOBEACHIEVED_4" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_4"]
"OBJECTIVESTOBEACHIEVED_5" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_5"]
"OBJECTIVESTOBEACHIEVED_6" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_6"]
"OBJECTIVESTOBEACHIEVED_7" = $_["F1_S4a_OBJECTIVESTOBEACHIEVED_7"]
$exportlist += $obj
$exportlist | select "Employee full name", "Employee login name", "Department Name", "OBJECTIVESTOBEACHIEVED_0", "OBJECTIVESTOBEACHIEVED_1", "OBJECTIVESTOBEACHIEVED_2", "OBJECTIVESTOBEACHIEVED_3", "OBJECTIVESTOBEACHIEVED_4", "OBJECTIVESTOBEACHIEVED_5", "OBJECTIVESTOBEACHIEVED_6", "OBJECTIVESTOBEACHIEVED_7" | Export-Csv ~/Export.csv -noType
$SPWeb.Dispose()
any help would be much appreciated.

Should have googled before posting !
"OBJECTIVESTOBEACHIEVED_0" = [Microsoft.SharePoint.Utilities.SPHttpUtility]::ConvertSimpleHtmlToText($_["F1_S4a_OBJECTIVESTOBEACHIEVED_0"],-1) -replace '\s+', ' '
Clears all the additional white space. As always jrv you
have saved the day, many thanks for all the help.
Mal

How to remove esclamation mark from itunes

how to remove esclamation mark from itunes???

See these...
-> One computer using multiple iTunes Store authorizations
-> About iTunes Store authorization and deauthorization

How to load the data from .csv file to oracle table???

Hi,
I am using oracle 10g , plsql developer. Can anyone help me in how to load the data from .csv file to oracle table. The table is already created with the required columns. The .csv file is having about 10lakh records. Is it possible to load 10lakh records. can any one please tell me how to proceed.
Thanks in advance

981145 wrote:
Can you tell more about sql * loader??? how to know that utility is available for me or not??? I am using oracle 10g database and plsql developer???SQL*Loader is part of the Oracle client. If you have a developer installation you should normally have it on your client.
the command is
sqlldrType it and see if you have it installed.
Have a look also at the FAQ link posted by Marwin.
There are plenty of examples also on the web.
Regards.
Al

How to remove a folder from claud files

how to remove a folder from claud files?

Folder (and file) deletion is a two-part process. First you Archive the file from the Files page at https://creative.adobe.com/files, or by deleting it from the Creative Cloud Files folder on your computer. Then you Permanently Delete the folder from the Archive at https://creative.adobe.com/archive.
Help article: Creative Cloud Help | Manage and Sync files

[solved] How to remove specific pages from PDF file?

I'm looking for a way to remove few pages from PDF file.
Last edited by delor (2008-07-04 10:28:22)

To remove first page I did this:
pdftk original.pdf cat 2-end output result.pdf
Any other propositions ?

How to regularly load data from .csv file to database (using apex)

Hi,
i am using apex3 , I need to load data from a csv file to apex . I need to perform this automatically through code at regular time interval of 5-10 seconds.
Is it possible .If yes how ?. Please reply as early as possible. This will decide whether to use apex or not for this application.
this is question for Application Express. Dont know why in forum for BPEL
Edited by: TEJU on Oct 24, 2008 2:57 PM

Hello,
You really need to load the data every 5-10 seconds? Presumably it's read only?
I would look at using an Oracle external table instead, that way you just drop your CSV in a location the DB can read it and then you build a table that essentially references the underlying CSV (that way when you query the table you view the data in the CSV file).
Take a look at this link for a quick example on usage -
http://www.oracle-base.com/articles/9i/SQLNewFeatures9i.php#ExternalTables
Hope this helps,
John.
Blog: http://jes.blogs.shellprompt.net
Work: http://www.apex-evangelists.com
Author of Pro Application Express: http://tinyurl.com/3gu7cd
REWARDS: Please remember to mark helpful or correct posts on the forum, not just for my answers but for everyone!

How to remove empty lines from xml files after removing nodes from document

<pre>
Hi
<b>i have xml document, which is shown below
after removing some nodes from the document ,i am getting empty lines in place of removed nodes,how to resolve this and get the proper xml document without any errors</b>
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE Message SYSTEM "TRD01.dtd">
<Message>
<Header>
<CounterPartyType>CLIENT</CounterPartyType>
<CreationTime>20134455</CreationTime>
<ErrorCode>363 </ErrorCode>
<ErrorEnterPriseId>N</ErrorEnterPriseId>
<ErrorStatus>1</ErrorStatus>
<ErrorSystemId>STL</ErrorSystemId>
<ErrorTimes>31</ErrorTimes>
<MessageType>T</MessageType>
<RecipientEnterpriseId>N</RecipientEnterpriseId>
<RecipentSystemId>EXM</RecipentSystemId>
<Remarks>REMARSK</Remarks>
<SenderEnterpriseId>N</SenderEnterpriseId>
<SenderSystemId>TR</SenderSystemId>
</Header>
</Message>
<ErrorCode>363 </ErrorCode>
<ErrorEnterPriseId>NIHK</ErrorEnterPriseId>
<ErrorStatus>1</ErrorStatus>
<ErrorSystemId>STL</ErrorSystemId>
<ErrorTimes>31</ErrorTimes>
XPathExpression expression5 = xpath.compile(xmlpath5);
Object result5 = expression5.evaluate(doc, XPathConstants.NODE);
Node node5 = (Node) result5;
node5.getParentNode().removeChild(node5);
XPathExpression expression6 = xpath.compile(xmlpath6);
Object result6 = expression6.evaluate(doc, XPathConstants.NODE);
Node node6=(Node) result6;
node6.getParentNode().removeChild(node6);
XPathExpression expression7 = xpath.compile(xmlpath7);
Object result7 = expression7.evaluate(doc, XPathConstants.NODE);
Node node7=(Node) result7;
node7.getParentNode().removeChild(node7);
doc.normalize();
doc.normalizeDocument();
TransformerFactory tf = TransformerFactory.newInstance();
Transformer t = tf.newTransformer();
t.setOutputProperty(OutputKeys.INDENT, "yes");
t.setOutputProperty("{http://xml.apache.org/xslt}indent-amount", "4");
t.setOutputProperty(OutputKeys.METHOD,"xml");
t.setOutputProperty(OutputKeys.ENCODING, "UTF-8");
the xml output i am getting is
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<Message>
<Header>
<CounterPartyType>CLIENT</CounterPartyType>
<CreationTime>20134455</CreationTime>
<MessageType>TRD01</MessageType>
<RecipientEnterpriseId>N</RecipientEnterpriseId>
<RecipentSystemId>STL</RecipentSystemId>
<Remarks>REMARSK</Remarks>
<SenderEnterpriseId>N</SenderEnterpriseId>
<SenderSystemId>T</SenderSystemId>
</Header>
</Message>
<b>could you please let me know how to avoid empty lines in the xml doucment output</b>
this is the method i am using to get the result
public void ValidateRecord(String xml){
try{
DocumentBuilderFactory factory = DocumentBuilderFactory.newInstance();
DocumentBuilder db = factory.newDocumentBuilder();
//parse file into DOM
/*DOMParser parser = new DOMParser();
parser.setErrorStream(System.err);
parser.setValidationMode(DTD_validation);
parser.showWarnings(true);*/
System.out.println ("HI THIS xml is validation "+xml);
Resolver res = new Resolver();
db.setEntityResolver(res);
Document doc = db.parse(new InputSource(new StringReader(xml)));
XPathFactory xpf = XPathFactory.newInstance();
XPath xpath = xpf.newXPath();
// XPathExpression expression = xpath.compile("//A/B[C/E/text()=13]");
String xmlpath="/Message/Header/CounterPartyType/text()";
String xmlpath1="/Message/Header/RecipentSystemId/text()";
String xmlpath2="/Message/Header/ErrorSystemId/text()";
XPathExpression expression = xpath.compile(xmlpath);
XPathExpression expression1 = xpath.compile(xmlpath2);
Object result = expression.evaluate(doc, XPathConstants.NODE);
Object result1 = expression1.evaluate(doc, XPathConstants.NODE);
Node node = (Node) result;
Node node1 = (Node) result1;
System.out.println("the values of the string is " +node.getNodeValue());
System.out.println("the values of the string is " +node1.getNodeValue());
// for (int i = 0; i < nodes.getLength(); i++) {
//System.out.println(nodes.item(i).getNodeValue());
// CAHNGING THE RECEIPENT NODE
XPathExpression expression2 = xpath.compile(xmlpath1);
Object result2 = expression2.evaluate(doc, XPathConstants.NODE);
Node node2 = (Node) result2;
System.out.println(node2);
node2.setNodeValue(node1.getNodeValue());
System.out.println(node2);
//removing the nodes from document
String xmlpath3="/Message/Header/ErrorCode";
String xmlpath4="/Message/Header/ErrorEnterPriseId";
String xmlpath5="/Message/Header/ErrorStatus";
String xmlpath6="/Message/Header/ErrorSystemId";
String xmlpath7="/Message/Header/ErrorTimes";
XPathExpression expression3 = xpath.compile(xmlpath3);
Object result3 = expression3.evaluate(doc, XPathConstants.NODE);
Node node3 = (Node) result3;
node3.getParentNode().removeChild(node3);
XPathExpression expression4 = xpath.compile(xmlpath4);
Object result4 = expression4.evaluate(doc, XPathConstants.NODE);
Node node4 = (Node) result4;
System.out.println("node value");
System.out.println(node4.getParentNode().getNodeName());
node4.getParentNode().removeChild(node4);
XPathExpression expression5 = xpath.compile(xmlpath5);
Object result5 = expression5.evaluate(doc, XPathConstants.NODE);
Node node5 = (Node) result5;
node5.getParentNode().removeChild(node5);
XPathExpression expression6 = xpath.compile(xmlpath6);
Object result6 = expression6.evaluate(doc, XPathConstants.NODE);
Node node6=(Node) result6;
node6.getParentNode().removeChild(node6);
XPathExpression expression7 = xpath.compile(xmlpath7);
Object result7 = expression7.evaluate(doc, XPathConstants.NODE);
Node node7=(Node) result7;
node7.getParentNode().removeChild(node7);
// Node b13Node = (Node) expression.evaluate(doc, XPathConstants.NODE);
//b13Node.getParentNode().removeChild(b13Node);
doc.normalize();
doc.normalizeDocument();
TransformerFactory tf = TransformerFactory.newInstance();
Transformer t = tf.newTransformer();
t.setOutputProperty(OutputKeys.INDENT, "yes");
t.setOutputProperty("{http://xml.apache.org/xslt}indent-amount", "4");
t.setOutputProperty(OutputKeys.METHOD,"xml");
t.setOutputProperty(OutputKeys.ENCODING, "UTF-8");
t.transform(new DOMSource(doc), new StreamResult(System.out));
catch (Exception e) {
e.printStackTrace();
System.out.println(e.getMessage());
</pre>
Edited by: user12185243 on Apr 6, 2013 6:38 AM
Edited by: user12185243 on Apr 6, 2013 6:41 AM
Edited by: user12185243 on Apr 6, 2013 6:43 AM
Edited by: user12185243 on Apr 6, 2013 6:45 AM
Edited by: user12185243 on Apr 6, 2013 9:00 AM

either this way we can do this
1)
DocumentBuilderFactory factory = DocumentBuilderFactory.newInstance();
<b> factory.setIgnoringElementContentWhitespace(true); </b>
DocumentBuilder db = factory.newDocumentBuilder();
or
2)
java.io.StringWriter sw = new java.io.StringWriter();
StreamResult sr = new StreamResult(sw);
t.transform(new DOMSource(doc), sr);
String xml1 = sw.toString().trim();
<b> xml1=xml1.replaceAll("\\s",""); </b>
System.out.println(xml1.trim());

How to invoke and receive from csv file

I have an employee.csv file which contains empid and empname deatils,
I want to fetch corresponding empid by giving input as empname from the employee.csv file and write empid into DB
I had created an read file for employee.csv, but for the receive activity only one variable is created
how to give input(empname) to the file and to get the empid from that file.
Please help me from this issue

In receive activity output file will contain the information of the entire list of empid and emp names. Wrive java code in java embedded activity to fetch the details of your desired output then use assign activity to continue your flow.
try {
oracle.xml.parser.v2.XMLText text =(oracle.xml.parser.v2.XMLText)getVariableData("OnMessage_composeAndDistributeMQ_InputVariable","payload","/client:composeAndDistributeRequest/client:ControlInformation/client:SystemID/text()");
String SystemID = text.getNodeValue();
Calendar cal = Calendar.getInstance();
SimpleDateFormat justDateTime = new SimpleDateFormat("yyyyMMddHHmmss");
String DateTimeString = justDateTime.format(cal.getTime());
SimpleDateFormat df = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss:SSS");
Date now = new Date();
addAuditTrailEntry("Now = " + df.format(now));
long timeInMilli = now.getTime();
addAuditTrailEntry("Date() - Time in milliseconds: " + now.getTime());
String DRI = SystemID + "003" + DateTimeString + timeInMilli + "0000001";
setVariableData("Invoke_RequestMQ", "body", "/ns2:DocumentRequests/ns2:DocumentRequest/ns2:MailItemInfo/ns2:DocumentRequestId", new String(DRI));
catch (Exception e) {
e.printStackTrace();
}

How to remove empty space from a file

Hi all,
Can any one help on how to remove the blank spaces from a file.
I used trim function but unable to remove the spaces.
I have a file in which there is a name like 'JAIRAM' and am storing this file in a variable FILE_CONTENTS.
Now am unable to compare FILE_CONTENTS with another value as it is storing empty spaces also from the file.
Please help on this
Thanks,
Srini

Trim only trim at the beginning or at the end. Can you try using the replace sql function.. see below..
SQL> select replace('abc def',' ','') from dual ;
REPLAC
abcdef
cheers

Removing quotation marks from channel names

Firstly - I am new to both DIAdem and VB so please forgive my ignorance!
I have a large data set containg many groups with (almost) identical channel names in each group. For reasons not worth going into some of the channel names have quoation marks around them, while others do not.
I am trying to remove the quoation marks to make all channel names consistent throughout the groups, for this I was hoping to loop through the groups renaming channels as appropriate
I think this should work:-
For
i = 1 to GROUPCOUNT
Call GROUPDEFAULTSET(i)
CN(""ChannelName"")="ChannelName"
Next
Where ChannelName is the name I am trying to replace, But I get the following error:- Expected ')'
Can anyone point out where I am going wrong?
(Note - I also tried using triple quotation marks ("""ChannelName"""), but I get this error instead - CN(""ChannelName""):=ChannelName Close bracket ")" expected for field index)
For bonus points - how to I get the loop to skip over any groups where the channel I am referencing already doesn't have quotation marks in it, rather than giving me an error that the channel can't be found?
Many thanks in advance for any assistance!
Dan
Solved!
Go to Solution.

Hello Dan,
You are using an old script syntax to manipulate the data. Please find below the current way to replace quotation marks with an underscote:
dim iLoopG, iLoopC, oGroup, oGroupChns, sQM
sQM = chr(34) ' the " character
set oGroup = Data.Root.ChannelGroups
for iLoopG = 1 to oGroup.Count
set oGroupChns = oGroup(iLoopG).Channels
for iLoopC = 1 to oGroupChns.Count
'msgbox oGroupChns(iLoopC).Name
oGroupChns(iLoopC).Name = Replace(oGroupChns(iLoopC).Name, sQM, "_")
next
next
Greetings
Walter

Remove quotation marks from a keyword

Hi, need a help on this....
I build a whole tree for my keywords and in some of them, I used more them one word in the same keyword, separated by comma.
eg: whale, whales
The problem is when I do that, it creates a quotation mark and the other softwares dont understand it as 2 words and can not slipt it.
Is there any way I can get rid of the quotation marks?
Thanks in advance for any help.

So it looks as if it can't be done the way you want it to work.
There is a work around but requires a little more work.
Insert the keywords as you are doing at the present.
Then run a script on the selected documents to sort the keywords removing the quotes.
Here is a script that will do just this...
#target bridge
if( BridgeTalk.appName == "bridge" ) {
var menu = MenuElement.find ('updateKeywords');
if (menu == null){
updateKeywords = MenuElement.create( "command", "Update Keywords", "-at the end of tools", "updateKeywords" );
updateKeywords.onSelect = function () {
if (ExternalObject.AdobeXMPScript == undefined) ExternalObject.AdobeXMPScript = new ExternalObject("lib:AdobeXMPScript");
var sels = app.document.selections;
for(var a in sels){
var xmpf = new XMPFile(sels[a].spec.fsName, XMPConst.UNKNOWN, XMPConst.OPEN_FOR_UPDATE);
var xmp = xmpf.getXMP();
var keys = getArrayItems(XMPConst.NS_DC,'subject').replace(/[";]/g,',');
keys = keys.split(',');
xmp.deleteProperty(XMPConst.NS_DC,'subject');
        for(var s in keys){
        xmp.appendArrayItem(XMPConst.NS_DC, "subject", keys[s], 0,XMPConst.PROP_IS_ARRAY);
if (xmpf.canPutXMP(xmp)) {
        xmpf.putXMP(xmp);
         xmpf.closeFile(XMPConst.CLOSE_UPDATE_SAFELY);
function getArrayItems(ns, prop){
var arrItem=[];
var items = xmp.countArrayItems(ns, prop);
   for(var i = 1;i <= items;i++){
     arrItem.push(xmp.getArrayItem(ns, prop, i));
return arrItem.toString();
To install..
Copy and paste the script into ExtendScript Toolkit
This gets installed with Photoshop and can be found:-
PC: C:\Program Files\Adobe\Adobe Utilities
MAC: <hard drive>/Applications/Utilities/Adobe Utilities
Start Bridge
PC: Edit - Preferences - Startup Scripts
Mac: Adobe Bridge menu - Preferences - Startup Scripts
At the bottom click the "Reveal Button" this will open the folder where the script should be saved.
Close and restart Bridge.
Accept the new script.
To use:-
Select the documents to update
Tools - "Update Keywords"

How to refer/store a vaue from csv file in control file

Hi,
Consider the following control file script.
Load data
infile 'suv.csv'
     append      into table mast_equipmnet_test
fields terminated by "," optionally enclosed by '"'
TRAILING NULLCOLS
equipment_id,
sub_vehicle_type,
ebiz_carrier_no expression "(select ebiz_carrier_no from mast_carrier where carrier_id=?)",
licence_no,
equip_type,
ebiz_appown_no,
ebiz_equip_no sequence(1,1)
here is my csv file
CABNO,          SUBTYPE     CARRIER_ID               REG_NO,     VEHICLE_TYPE,          EBIZ_APPOWN_NO
6954,          SUMO,          SWAMY,                         6954,          SUV,                    228
9183,          SUMO,          SWAMY,                         9183,          SUV,                    228
3173,          QUALIS,          SWAMY,                         3173,          SUV,                    228
In my csv file i have carrier_ids which are string values in 3rd column.
for every carrier_id ,the corresponding ebiz_carrier_no(numeric value) is stored in a master table called "mast_carrier".
While loading the data i need to fetch the ebiz_carrier_no for each carrier_id from mast_carrier table .
but here i got strucked in the where clause of select statement.
I am not able to refer the carrier_id from csv file in where clause.
can any body tell me how to refere a value from csv file in the select statement of control file script.
cheers
RRK

Sorry..
"EXPRESSION" is not needed..
ebiz_carrier_no "(select ebiz_carrier_no
from mast_carrier
where carrier_id=:ebiz_carrier_no )",
<br>
<br>
"Tested" as
<br>
load data
infile *
into table t truncate
fields terminated by ','
(id,
name "(select ename from emp
                   where empno = :name)"
begindata
1,7900
2,7902
<br>
QL> select * from t;
       ID NAME
        1 JAMES
        2 FORD

How to remove a character in a file??

I'm not getting how to remove a character from a file.Could anyone post a method to do this?Any help would be appreciable.

Ohhh... and one more thing... unless you're really unlucky, a few "extranious trailing nulls" won't make a jot of difference to the size of the file on disk, each each file "fills" whole blocks anyway, which is 1K (I think) on both fister and *nix... unless of course we're talking "lots" of trailing-nulls, or lots-and-lots of files.

How to Load the data from excel file(Extension is .CSV) into the temp.table

Hi
How to Load the data from excel file(Extension is .CSV) into the temporary table of oracle in Forms11g.
My Forms Version is - Forms [64 Bit] Version 11.1.2.0.0 (Production)
Kindly Suggest the Solution.
Regards,
Sachin

Hello Sachin,
You can use the following metalink note:How to Read Data from an EXCEL Spreadsheet into a Form Using Webutil Client_OLE2 (Doc ID 813535.1) and modify it a little bit.
Instead of copy values into forms you can save them in your temporary table.
Kind regards,
Alex
If someone's helpful or correct please mark it accordingly.

How to remove quotations marks from csv file

Similar Messages

Maybe you are looking for