Using PowerShell to Add Columns to A CSV File

Hello,I wonder if someone can shed some light on this. I have a PowerShell script which has been working perfectly well pulling tab-seperated text log files off individual PCs, adjusting the data within and combining them into a single CSV for processing by our reporting tools via Excel and SQL. These files are call history logs generated by Toshiba Call Manager software installed on each PC. They keep a log of every call made by the phone linked to the individual user's software. By combining them for reporting, we get a clear and accurate picture of time spent on the phone etc.The problem we have is I need two extra columns added. One is for the person's name ('Person'), taken from the log file name, the other is a column for the call duration (which is logged under 'Dur' as a unit of time, e.g. 4:12 for 4 mins 12 seconds) and we...
This topic first appeared in the Spiceworks Community

Similar Messages

SQL*Loader - How to load only a few columns from a .csv file to ora table

Hi there,
Could anyone please let me know how to load few columns from a .csv
file into a oracle table using SQL*Loader.
I know how to create a .dat and .ctl file and run the sql loader.
Suppose I have a .csv file with
col1, col2, col3, col4
and I only need to load col1 and col3 into col_a and col_b respectively
in table_a?
structure of table_ a
col_a,
col_b
Please advice

Try like..it i will work..
LOAD DATA
INFILE 'test.txt'
LOAD DATA
TRUNCATE INTO TABLE T1
FIELDS TERMINATED BY ','
(col1,
col2 FILLER,
col3,
col4 FILLER
)

Writing ouput to the next column in a .csv file

I am Writing to .CSV file with PL/SQL code:
CREATE OR REPLACE PROCEDURE Write_File(p_name IN VARCHAR)
AS
BEGIN
DECLARE
CURSOR emp_sel IS SELECT ename,hiredate FROM EMP;
file_name VARCHAR2(20);
output_file utl_file.file_type;
BEGIN
file_name:= (p_name||'.csv');
output_file:=utl_file.fopen('d:\test_dir',p_name||'.csv','W');
FOR i IN emp_sel LOOP
utl_file.put_line(output_file,'NAME:'||i.ename);
utl_file.put_line(output_file,'hire Date:'||i.hiredate);
END LOOP;
utl_file.fclose(output_file);
EXCEPTION
WHEN OTHERS THEN
dbms_output.put_line(SQLCODE||SQLERRM);
END;
END;
Just wanted to know how Move to the next Column in the .csv file.
at present the ename and hiredate r written in the 1st Column C1 column.
I want to write the hiredate data in C2 column.
how to?

user545846,
I answered you in the other thread:
Re: Calling utl_file package from a java program
Good Luck,
Avi.

Import-csv how to make powershell ignore a line in a csv file if a column contains a certain value

Basically I got a very basic script that uses a csv file to input values needed to remove people from a distro list. That part is working fine. I'd like to add to it's functionality so it can look at values in a certain column, and if any of those certain
values are present, I want powershell to skip that line and not process it. For instance I have a column in the csv called Group. If I have a listing under Group that says ABC I want the script to skip that line and not try to process it. What could I insert
into the script to acheive this?

You're welcome. You can add to the if test with -and:
Import-Csv .\groups.csv | ForEach {
If ($_.Group -ne 'ABC' -and $_.Group -ne 'DEF') {
Write-Output "Group is $($_.Group)"
Write-Output "Name is $($_.Name)"
Output:
Group is GHI
Name is Show Me
groups.csv:
Group,Name
ABC,Skip Me
DEF,Skip Me Too
GHI, Show Me
Don't retire TechNet! -
(Don't give up yet - 13,085+ strong and growing)

Using PowerShell to add VBA to an Excel spreadsheet

I have a PowerShell script that creates an Excel spreadsheet and is able to save it. I also have VBA code that I would like to put into that newly created spreadsheet.
Is there a way of adding the VBA code into my newly created spreadsheet using PowerShell?
Thanks,

Thanks for the response Alex,
Where I use to work, we would commonly do this with VBScript and Excel 2003. Below is an example from the Scripting Repository using VBScript (Add a Macro
to an Excel Spreadsheet)
Set objExcel = CreateObject("Excel.Application")
objExcel.Visible = True
objExcel.DisplayAlerts = False
Set objWorkbook = objExcel.Workbooks.Open("C:\scripts\test.xls")
Set xlmodule = objworkbook.VBProject.VBComponents.Add(1)
strCode = _
"sub test()" & vbCr & _
" msgbox ""Inside the macro"" " & vbCr & _
"end sub"
xlmodule.CodeModule.AddFromString strCode
objWorkbook.SaveAs "c:\scripts\test.xls"
objExcel.Quit
We would use a variant of this method to generate static Excel reports from spreadsheets that were linked to external data sources.
Now... it's time for me to upgrade my code and get on the PowerShell boat :) So I have been working on a script that does a similar thing, but there does not appear to be a method of adding a macro to an Excel spreadsheet using PowerShell. There
appears to be no way of calling VBProject.VBComponents.Add from within PowerShell.
I have tried manipulating the data that resides within Excel by directly accessing it from PowerShell, but this has proven to be painfully slow. What a macro can do in 3 seconds, takes PowerShell 8 hours to do :(
If it can't be done... then I'll have to revert back to my old ways. But if it can be done, great!!! PowerShell has alot more to offer me than VBScript did.

SP 2013 - Use PowerShell to Add a Custom Web Part to a Page

Hello Community,
I need to add a custom web part to a page using PowerShell - has anyone done this and if so please provide guidance and code examples.
Thanks!
Tom
Tom Molskow - Senior SharePoint Architect - Microsoft Community Contributor 2011 and 2012 Award -
Linked-In - SharePoint Gypsy

BTW, here is my current code:
#$web= Get-SPWeb -Identity "http://c4968397007/sites/BRE"
$Url = "http://c4968397007/sites/BRE"
$pageUrl = "/SitePages/Home"
$webpartzone = 2
$index = 0
$fileName = "wp_DistrictHomePage_VisualWebPart1.webpart"
$web = Get-SPWeb $Url
$web.AllowUnsafeUpdates=$true
$webPartGallery = $web.Lists["Web Part Gallery"]
Write-Host "Searching webpart $fileName in web part gallery"
if($webPartGallery -eq $null)
Write-Host("Unable to retrieve Webpartgallery");
$webpart = $null;
$webpart=$webPartGallery.Items | ? { $_.Title -eq $fileName}
if($webpart -eq $null) {
Write-Host("Unable to retrieve webpart: $fileName") -ForegroundColor Red
else {
Write-Host("----------Adding Webpart--------")-ForegroundColor Yellow
$webpartmanager=$web.GetLimitedWebPartManager($pageUrl, [System.Web.UI.WebControls.WebParts.PersonalizationScope]::Shared)
$errorMsg = "";
$xmlReader = New-Object System.Xml.XmlTextReader($webpart.File.OpenBinaryStream());
$webpart = $webpartmanager.ImportWebPart($xmlReader,[ref]"Error")
$webpartmanager.AddWebPart($webpart, $webpartzone, $index);
Write-Host("Webpart is added successfully") -ForegroundColor Green ;
$SiteURL =$Url
#---------------Test Page----------------------------
$PageName="Test.aspx"
$page=$web.lists["Pages"].Items | ? {$_.Name -eq $PageName}
$page.File.CheckOut();
Add-WebPartToPage "$SiteURL/Pages/$PageName" "Header" 0 "My Custom WebPart"
$page.File.CheckIn("Added Web part to a page");
$page.File.Approve("Added Web part to a page");
Tom Molskow - Senior SharePoint Architect - Microsoft Community Contributor 2011 and 2012 Award -
Linked-In - SharePoint Gypsy

How to add colors to a CSV file?

Hi there,
I'm exporting data to a CSV file using printWriter.
Question: is it possible to add colors, bold text or stretch the length of a column in the produced CSV file?
This, of course, should be the end result of the file (not do it when the file is open)
Thank you!

xianwinwin wrote:
Question: is it possible to add colors, bold text or stretch the length of a column in the produced CSV file?Of course if you assumed that you'd be looking at the file with a fixed-width font, you could insert a bunch of tabs or spaces to get columns to match up, but I strongly advise you not do that. I think of CSV as a poor-man's excel data file or perhaps a flat database file, but most importantly it holds data in a standard format that can be read and manipulated by many different programs, including ones you write yourself. It is not meant to be for pretty visualization. Try to pretty it up and you possibly ruin it's main reason for existing. For nice visualization I'd create a small app that read the CSV, formatted it nicely and either displayed the data or stored it in some pretty format as a non-CSV file.

Is it possible to use Powershell to determine if Windows Server Source Files are present on disk?

Hi everyone,
I would like to know if it is possible to use a Powershell cmdlet to determine if Windows Server 2012 (R2) Source Files are present on disk.
We are using an automated PS script to install roles and features and some registry keys and applications afterwards. If the Source Files are not present, the script will fail, so I would like a# Check if Source Files are present # stage built in
the script to determine if the source files are present or that an alternate source path needs to be used.
Is this possible with Powershell and if so, how can we achieve this?
I'll appreciate your answer.
- Rob

Hi Rob,
I assume that you are using powershell command "install-windowsfeature" .
I would suggest you add the parameter "-source" to specify the alternate path of thesource file .
" The path specified in this parameter is only used if the command cannot find feature files in the local side-by-side store of the specified target computer or VHD. "
For details please refer to the article below :
https://technet.microsoft.com/en-us/library/jj205467(v=wps.620).aspx
Best Regards,
Elton Ji
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact [email protected] .

Uploading document using Powershell is throwing error- There is no file with URL

Hi.
I am trying to upload multiple documents to a sub folder in a library using powershell.
I am getting the error as : ForEach-Object : Exception calling "Add" with "3" argument(s):
"<nativehr>0x80070003</nativehr><nativestack></nativestack>There is no file
with URL 'server/TestLibrary/User_image/ab_3f_wht_ist_small_gif.gif' in this Web."
I have used the below code:
function UploadImages($weburl)
$docLibraryName = "TestLibrary"
$localFolderPath = "C:\Users\Imgs\user_image"
Add-PsSnapin Microsoft.SharePoint.PowerShell -erroraction silentlycontinue
$web = Get-SPWeb -Identity $webUrl
$docLibrary = $web.Lists[$docLibraryName]
$subFolderName="user_image"
Add-PsSnapin Microsoft.SharePoint.PowerShell -erroraction silentlycontinue
$web = Get-SPWeb -Identity $webUrl
$docLibrary = $web.Lists[$docLibraryName]
#Attach to local folder and enumerate through all files
$files = ([System.IO.DirectoryInfo] (Get-Item $localFolderPath)).GetFiles() | ForEach-Object {
#Create file stream object from file
$fileStream = ([System.IO.FileInfo] (Get-Item $_.FullName)).OpenRead()
$contents = new-object byte[] $fileStream.Length
$fileStream.Read($contents, 0, [int]$fileStream.Length);
$fileStream.Close();
write-host "Copying" $_.Name "to" $docLibrary.Title "in" $web.Title "..."
#Add file
$folder = $web.getfolder($docLibrary.Title + "/" + $subFolderName)
write-host "folder is " $folder
$spFile = $folder.Files.Add($folder.Url + "/" + $_.Name, $contents, $true)
$spItem = $spFile.Item
Write-Host -f Green "Added Images to Library !!!"
$web.Dispose()
How to fix this?
Thanks

HI,
Is the name of the image or the sub folder name the issue?
I have the images with the name as "ab_3f_wht_ist_small_gif.gif". folder name "User_image"
There are underscores on the file name, but there is no space. When I add the file from the library (using the UI), the image is getting added.
But adding through the powershell is giving the issue.
I have checked this:
http://social.msdn.microsoft.com/Forums/sharepoint/en-US/e810ad03-81ef-4fa6-aab8-ddc896a13ebf/getting-error-during-uploading-a-document-using-powershell?forum=sharepointdevelopmentprevious
but did not help.
Thanks

Power shell search one column of a csv file and replace text in that column

I have a huge CSV file.
Column J has number which represents states.
I would like to search through column J of output.csv and replace the number with the state name.
J
State
233
219
233
210
Becomes
J
State
NC
TN
NC
SC
I have tried several methods that seem to do noting or erase everything in my csv file or at best searches every column and if a phone number has 210 in it, it changes it to SC.
Can any one point me in the correct location?
Thanks!
R White

Thanks so much
I gave it a try using this
Import-Csv C:\temp\outfile.csv| ForEach-Object {
if ($_.State.tostring() -like '256') { $_.State.tostring().replace('256', 'Somethingelse256')}
if ($_.State.tostring() -like '257') { $_.State.tostring().replace('257', 'Somethingelse257xx')}
} | export-csv C:\temp\outfileNEW.csv
it produced a C:\temp\outfileNEW.csv
with only a column A that had this all the way down it
#TYPE System.String
Length
16
16
16
16
16
16
16
R White

Using SQL LOADER in Oracle to import CSV file

I'm pretty new to databases and programming. Im not very good with the computer lingo so stick with me. I have a csv file that I'm trying to load into my oracle database. It contains account information such as name telephone number service dates ect. I've installed Oracle 11g Release 2. This is what I've done so far step by step..
1) Ran SQL Loader
I created a new table with the columns that I needed. For example
create table Billing ( TAP_ID char(10), ACCT_NUM char(10), MR_ID char(10), HOUSE_NUM char(10), STREET char(30), NAME char(50)
2) It prompted me that the Table was created. Next I created a control file for the data in notepad which was located in the same directory as my Billing table and has a .ctl extension. GIS.csv is the file im getting the data from and is also in the same directory and named it Billing.ctl, which looked like so..
load data
infile GIS.csv
into table Billing
fields terminated by ','
(TAP_ID, ACCT_NUM, MR_ID, HOUSE_NUM, STREET, NAME)
3) Run sqlldr from command line to use the control file
sqlldr myusername/mypassword Billing.ctl
This is where I am stuck. Ive seen video tutorials of exactly what I'm doing but I get this error:
SQL*Loader-350: Syntax error at line 1.
Expecting keyword LOAD, found "SERV TAP ID". "SERV TAP ID","ACCT NUMBER","MTR ID","SERV HOUSE","SERV STREET","SERV ^'
I dont understand why its coming up with that error. My billing.ctl has a load.
load data
infile GIS.csv
into table Billing
fields terminated by ','
(TAP_ID, ACCT_NUM, MTR_ID, SERV_HOUSE, SERV_STREET, SERV_TOWN, BIL_NAME, MTR_DATE_SET, BIL_PHONE, MTR_SIZE, BILL_CYCLE, MTR_RMT_ID)
Any thoughts?

938115 wrote:
I also got this text file after the command was executed along with the GIS.bad file
SQL*Loader: Release 11.2.0.1.0 - Production on Fri Jun 1 09:56:52 2012
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
Control File: bill.ctl
Data File: GIS.csv
Bad File: GIS.bad
Discard File: none specified
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 50
Bind array: 64 rows, maximum of 256000 bytes
Continuation: none specified
Path used: Conventional
I have thousands of records in this file and only 64 of them updated.How many record were in the table before and after? I doubt the difference is 64, unless you have exactly 64 rows but you said thousands. I believe you are probably misinterpreting the log file. can you share the full log file? As a test, create a empty table, use the same script and load same data file in this empty table. Once loading is complete, check if it has 64 rows or more. I believe what log file is saying, it is 'commiting after every 64 rows', not 'stopping after loading 64 rows'.
So, unless you show us the log file there is no way to be certain, feel free to mask confidential info, at-least top 15 and bottom 15 lines ?

How to use auto fit selection when downloading to csv file

hi,
I am working on reports, i need to download to a .csv file. I am using GUI_DOWNLOAD is there any option for it where text fits exactly in a single cell.
For Eg:
I excel there is an option (Format-column-Autofitselection).
Then the column size increases or decreased according to the text size.

Dear Josephine,
There is no option the way you want of autofit. Rather while opening the CSV in excel u can do the required formatting.
Regards,
Deva.

Filtering columns in a .csv file v .xml file

Hi everyone,
The following code fragment apparently creates a dataset from an xml file. The first line creates the dsStates dataset from an xml file called states.xm. The second line seems to be pulling in the list of cities into the dsCities dataset from the same xml file. I mean I assume this is what it's doing since it's accessing {dsStates::url} and then "/state/cities/city".
var dsStates = new Spry.Data.XMLDataSet("../../data/states/states.xml", "/states/state");
var dsCities = new Spry.Data.XMLDataSet("../../data/states/{dsStates::url}", "/state/cities/city");
My question is that since I'm not using xml as the source file for the dataset I'm creating but instead I'm using a .csv file, I'm wondering whether I can create two similar constructor functions like the above xml versions. I assumed that the first line would be as follows:
var dsTypes = new Spry.Data.CSVDataSet("data/types.csv");
This would bring in the data from a .csv file called "types.csv".
The question is though how would I access certain columns in this types.csv file so that I can filter them into the second dataset which would be called dsHospitals. I started off with the following line:
var dsHospitals = new Spry.Data.CSVDataSet("    ");
...but then since it's not xml is there are way to target these columns as it's done in the xml version. Or are there limitations with what I can do with a .csv file compared to xml files?
Would really appreciate any advice.

Thanks for the reply,
I've actually ended up using an xml file instead of a .csv due to the limitations.
I'm pulling in some xml files dynamically into a table and have based the code on the information at the following url:
http://labs.adobe.com/technologies/spry/samples/data_region/SpryPagedViewSample.html
My application is identical to the one in the above url except that instead of bringing in state and cities, I'm bringing in categories instead of the states and hospital names and addresses instead of the cities.
The example in the url uses an unordered list to display the names of the cities as in the following code:
<div spry:region="pvFacilities dsFacilities">
      <ul spry:repeatchildren="pvFacilities" spry:choose="choose">
            <li spry:when="{pvFacilities::ds_RowID} == {pvFacilities::ds_CurrentRowID}" spry:select="select" spry:selectgroup="page" spry:selected="selected" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::name}</li>
            <li spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::name}</li>
      </ul>
</div>
I needed to revise this since I'm not only displaying one item, ie. the city name as in the example, but instead I'll be displaying the full hospital details which would require that the information is inserted into a table. So I had to adapt the above code to work with a table and I came up with the following:
   <div id="privRegion" spry:region="pvFacilities dsFacilities">
<table id="private" cellspacing="0" summary="A list of private hospitals">
<caption>Private Hospitals </caption>
<thead>
<tr>
    <th id="name" scope="col"><a href="#">Name</a>
      </td>
    <th id="address" scope="col">Address</td>
    <th id="suburb" scope="col"><a href="#">Suburb</a>
      </td>
    <th scope="col">State
      </td>
    <th scope="col">Postcode</td>
    <th scope="col">Phone</td>
    <th scope="col">Fax</td>
</tr>
</thead>
<tbody>
<tr spry:repeatchildren="pvFacilities" spry:choose="choose">
    <td spry:when="{pvFacilities::ds_RowID} == {pvFacilities::ds_CurrentRowID}" spry:select="select" spry:selectgroup="page" spry:selected="selected" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::Name}</td>
    <td spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::Address}</td>
    <td spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::Suburb}</td>
    <td spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::State}</td>
    <td spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::Postcode}</td>
    <td spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::Phone}</td>
    <td spry:default="default" spry:select="select" spry:selectgroup="page" spry:hover="hover" spry:setrow="pvFacilities">{pvFacilities::Fax}</td>
</tr>
</tbody>
</table>
</div>
When I test though, it's only bringing in the first row and even then, it's only bringing in the hospital name and then 19 of the phone numbers from other hospitals! Not exactly what I was aiming for?
Are you able to take a look at the following url to see where I may have gone wrong?
http://files.officelinkonline.com.au/spry_test/
Really appreciate any help/advice.

How can i get the column names in CSV file.

Hi,
After execution of infospoke i can not see the column names in that file.How can i get column of respective infoprovider?
Thanks,
Gananadha Lenka

Hello Gana,
Actually while exporting the data using Info Spoke, we have the possibility to modify the data that we send. This is possible using transformations.
In your Info Spoke, you have a tab called Transformations.
Here you need to create an implementation and then use BADi to populate data.
Check if you can write a start routine sort of thing here and insert a new record into the internal table by hardcoding with your field headings.
Let me know if you dont know how to create transformations.
Kris...

Add text to downloaded CSV file

Hi.
I'm trying to place a text at the bottom of the csv file, but I can not find the way to do it.
What I'm trying to do is, after all rows downloaded in my csv file, I'd like to place a general comment in the next row regarding some information about the data I've downloaded.
Is this possible?
Thanks
Ivo

one of my colleagues might have a better answer for this, but one not-so-elegant way to get a message to display at the bottom of your csv output would be to manually put your own "download to csv" link on your page. have that link go to another page in your app that reports on the same query as your original report. put a region of type HTML right after your duplicate report region that displays the text you want to see in your csv output (be sure to use "No Template" for this region's template). change the report template of the second report region to "export: CSV". now when users click your manually added "download to csv" link, they'll be linked over to your other page. that page will immediately output the csv data as well as the additional line from your extra HTML region.
hope this helps,
raj

Using PowerShell to Add Columns to A CSV File

Similar Messages

Maybe you are looking for