Download a UNIX based CGI page into a CSV file using Powershell

Hello,
I have been struggling to get a powershell script to work.
I have a web-based page which ends in .cgi and I want to copy the text from that page to a CSV file.
Normally the below script works for .html or .aspx types of pages but this time I have been getting the 'The remote server returned an error: (401) Unauthorized' page. I think the error is because the page is Unix based and for some reason I am not
able to automate the authentication process.
Below is the Powershell script I have been using. I have already created the securestring for my password and saved in a temp folder.
$wc=new-object system.net.webclient
$password = get-content 'C:\temp\Scripts\SecureString.txt' | convertto-securestring
$wc.Credentials = new-object -typename System.Management.Automation.PSCredential -argumentlist "Domain\username", $password
$wc.downloadfile("https://website.domain.com/cgi-bin/text_status_csv.cgi", "C:\temp\Scripts\output.csv")
Currently I am able to successfully copy the data from the page over if I use
$wc.Credentials = Get-Credential
And then type in the username and password manually. I could really use some help to get this automated.
Thanks in advance for your help

A little searching and you will find hundreds of examples.
https://www.google.com/#newwindow=1&q=powershell+persist+credentials
¯\_(ツ)_/¯

Similar Messages

How to get DocSet property values in a SharePoint library into a CSV file using Powershell

Hi,
How to get DocSet property values in a SharePoint library into a CSV file using Powershell?
Any help would be greatly appreciated.
Thank you.
AA.

Hi AOK,
Would you please post your current script and the issue for more effcient support.
In addition, to manage document set in sharepoint please refer to this script to start:
### Load SharePoint SnapIn
2.if ((Get-PSSnapin "Microsoft.SharePoint.PowerShell" -ErrorAction SilentlyContinue) -eq $null)
3.{
4. Add-PSSnapin Microsoft.SharePoint.PowerShell
5.}
6.### Load SharePoint Object Model
7.[System.Reflection.Assembly]::LoadWithPartialName(“Microsoft.SharePoint”)
8.
9.### Get web and list
10.$web = Get-SPWeb http://myweb
11.$list = $web.Lists["List with Document Sets"]
12.
13.### Get Document Set Content Type from list
14.$cType = $list.ContentTypes["Document Set Content Type Name"]
15.
16.### Create Document Set Properties Hashtable
17.[Hashtable]$docsetProperties = @{"DocumentSetDescription"="A Document Set"}
18.$docsetProperties = @{"CustomColumn1"="Value 1"}
19.$docsetProperties = @{"CustomColum2"="Value2"}
20. ### Add all your Columns for your Document Set
21.
22.### Create new Document Set
23.$newDocumentSet = [Microsoft.Office.DocumentManagement.DocumentSets.DocumentSet]::Create($list.RootFolder,"Document Set Title",$cType.Id,$docsetProperties)
24.$web.Dispose()
http://www.letssharepoint.com/2011/06/document-sets-und-powershell.html
If there is anything else regarding this issue, please feel free to post back.
Best Regards,
Anna Wang
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Support, contact [email protected]

How to scan more pages into one PDF file using hP inkjet 2515

Dear friend
How to scan more pages into one PDF file using hP inkjet 2515

Dear friend
How to scan more pages into one PDF file using hP inkjet 2515

How do I scan multiple pages into one pdf file using the PIXMA MG7520 on Windows 8.0? Please help!

I recently received a PIXMA MG7520 for a gift. It works great with my lenovo laptop/tablet running on Windos 8.0. The one drawback to the HP all-in-one that it replaced is it does not have an ADF. That being said, there must be some way to scan multiple pages into one pdf file. I need help figuring thing out. Thanks in advance!
Solved!
Go to Solution.

Hi mdtolbert54,
There is a program that comes with the printer called the IJ Scan Utility that can assist you with scanning multiple pages into a single PDF document. To do this, please follow these steps:
1. On your keyboard, press the Windows key.
2. Start typing IJ SCAN UTILITY. The search window opens as you type. Once the IJ SCAN UTILITY is displayed, please select and open it.
3. In the Canon IJ Scan Utility window that opens, click SETTINGS.... in the bottom right of the window. The Settings dialog box appears.
4. Click the DOCUMENT SCAN option on the left pane of the window.
5. In the SAVE SETTINGS section of the window, you will select the save format and location of the document you are about to scan.
a.) In the FILE NAME field, specify the name you would like to give the file. By default the filename will begin with IMG; you can remove IMG and change it to whatever you would like to name the file.
b.) In the DATA FORMAT field, use the drop-down arrow to select the PDF (Multiple Pages) option.
c.) In the SAVE IN field, please navigate to the area where you would like the file to be saved once it is scanned in. By default, the file will be saved in the MY DOCUMENTS folder.
6. Once all settings have been selected, click the OK button at the bottom of the window to save the changes. The IJ Scan Utility main screen appears.
7. Click the DOCUMENT button. Scanning starts. Click the CANCEL button to cancel scanning if needed. Scanned items are saved in previously selected folder location specified in the SETTINGS... window.
If you find that you need advanced scanning options such as adjusting resolution, brightness, contrast, saturation, color balance, etc. in addition to the options selected above, please click on the SCANGEAR button on the IJ Scan Utility Main screen, then adjust the items as necessary.
Once the items above are set for document scanning, in the future, you will only need to launch the IJ Scan Utility, then press the DOCUMENT button to perform the scan (unless you want to make changes to the settings).
Hope this helps!
This didn't answer your question or issue? Please call or email us using one of the methods on the Contact Us page for further assistance.
Did this answer your question? Please click the Accept as Solution button so that others may find the answer as well.

Split records into Multiple csv files using a Threshold percentage

Hi Gurus,
I have a requirement to split the data into two csv file from a table using a threshold value(in Percentage) .
Assume that If my source select query of interface fetches 2000 records , I will provide a threshold value like 20%.
I need to generate a csv1 with 400 records(20% of 2000) and the rest of the records into another csv2.
For implementing this I am trying to use the following process.
1) Create a procedure with the select query to get the count of records.
Total Records count: select count(1) from source_table <Joins> <Lookups> <Conditions>;
2) Calculate the Record count to first CSV using the threshold_value.
CSV1_Count=Total records count /threshold_value
3) Create a view that fetches the CSV1_Count(400) records for CSV1 as follows.
Create view CSV1_view as select Col1,Col2,Col3 from source_table <Joins> <Lookups> <Conditions>
Where rownum<=CSV1_Count;
4) Generate CSV1 file using View 'CSV1_View'
5) Generate CSV2 File using the Interface with same select statement (with columns ) to generate a CSV.
select Col1,Col2,Col3 from source_table ST <Joins> <Lookups> <Conditions>
Left outer join (Select Col1 from CSV1_View ) CS on CS.Col1=ST.Col1 where CS.Col1 is null;
Which gives the Total records minus the CS1_View records.
The above process seems a bit complex and very simple . If any changes in my Interface I also need to change the procedure (counts the no:of records).
Please provide your comments and feedback about this and looking for your inputs for any new simple approach or fine tune the above approach.
Thanks,
Arjun

Arjun,
This are my thoughts and Lets do it in 3 Steps
Step 1. ODI Procedure
Drop table Temp_20 ;
Create table Temp_20 as select * from table where rownum < ( SELECT TRUNC( COUNT(1) /5) FROM TABLE ) .
[ ** This way iam fetching approx 20% of the table data and loading into Temp table . 1/5 th is 20% so i am dividing count by 5
I don't believe View will help you especially with RowNum as if you run the same query with rownum < N the rows order might differ . so Temp table is great ]
Step 2 . Use OdiSqlUnload with select columns from temp_20
Step 3 . Use again OdiSqlUnload with select columns from table where ( uk keys ) not in ( selecy uk_keys from temp_20)
[** this way you can pick the remaining 80% ** and the data will be not repeat itself across 20% and 80% , as might happen with view ]
what do you think ?

Exporting query results into a csv file using arabic and hebrew chars

Hi,
iv'e encountered a problem, using plsql to export a query into a csv file.. the arabic turns into question mark. Do you have any idea why?

Usually this indicates a mismatch between client and database character set.
How do you export this query?
What is your database version?
What is your client OS?
T.

How do I split a Large CSV file into Multiple CSV's Using Powershell

I am a novice at powershell but this looks to be the best tool to do this task. have a csv file that looks like this:
Date,Policy,Application
10/13/2014,No,None
10/13/2014,No,None
10/13/2014,No,None
10/13/2014,No,None
10/13/2014,No,None
11/14/2013,Yes,AppBiz
11/14/2013,Yes,AppBiz
11/14/2013,Yes,AppBiz
07/04/2013,No,PeopleBiz
07/04/2013,No,PeopleBiz
07/04/2013,No,PeopleBiz
07/04/2013,No,PeopleBiz
Is it possible to split this CSV into multiple CSV's based on "Application".
Lets say the output might look like:
None.csv
10/13/2014,No,None
10/13/2014,No,None
10/13/2014,No,None
10/13/2014,No,None
10/13/2014,No,None
AppBiz.csv
11/14/2013,Yes,AppBiz
11/14/2013,Yes,AppBiz
11/14/2013,Yes,AppBiz
PeopleBiz.csv
07/04/2013,No,PeopleBiz
07/04/2013,No,PeopleBiz
07/04/2013,No,PeopleBiz
07/04/2013,No,PeopleBiz
Any help would be greatly appreciated

I think this might be what you want:
Import-Csv applications.csv |
Group Application |
foreach {
$_.Group | Export-Csv "$($_.Name).csv" -NoTypeInformation
[string](0..33|%{[char][int](46+("686552495351636652556262185355647068516270555358646562655775 0645570").substring(($_*2),2))})-replace " "
Very nice! 4x faster..
I doubt the OP will get what you just did there..
Sam Boutros, Senior Consultant, Software Logic, KOP, PA http://superwidgets.wordpress.com (Please take a moment to Vote as Helpful and/or Mark as Answer, where applicable) _________________________________________________________________________________
Powershell: Learn it before it's an emergency http://technet.microsoft.com/en-us/scriptcenter/powershell.aspx http://technet.microsoft.com/en-us/scriptcenter/dd793612.aspx

Adding row into existing CSV file using C#

How to add row to existing CSV file using .NET Code.the file should not be overwrite,it need add another row with data.how to implement this scenario.

Hi BizQ,
If you only just write some data to CSV file. Please follow A.Zaied and Magnus 's reply. In general,we use CSV file to import or export some data. Like following thread and a good article in codeproject
Convert a CSV file to Excel using C#
Writing a DataTable to a CSV file
Best regards,
Kristin
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

How export a pie graph(displayed in jspx page) into a PPT file.

I am trying to export a pie graph(displayed in jspx page) into a PPT file using Apache POI. But I am facing a problem when I calling the below mentioned code from a button.
Code:
SlideShow slideShow = new SlideShow();
Slide slide = slideShow.createSlide();
FileOutputStream out = new FileOutputStream("slideshow.ppt");
slideShow.write(out);
out.close();
The above mention code is working and a blank ppt file is created when I am running the code from a standalone java class. But when it is called from button in an adf project code is not throwing any exception but the ppt file is not created.

Hi,
sorry but the code snippet alone doesn't help to solve the problem. Did you debug the code to see if it works? My assumption is that the file gets written, just not in the directory you are looking at
Frank

Retrieve all pages in a site collection using powershell command

Hi all,
I need to retrieve all pages in a site collection and i wanted to display it in a csv file using powershell command.Please help.
Regards,
Praveen

Hi Praveen,
Here are two blogs would be helpful:
PowerShell script to Enumerate Sites, Sub-sites and print them in a .csv file
http://www.sharepointfix.com/2012/02/powershell-script-to-enumerate-sites.html
Powershell to Loop through all SharePoint sites and pages
https://tjendarta.wordpress.com/2013/03/19/powershell-to-loop-through-all-sharepoint-sites-and-pages/
Best Regards
TechNet Community Support
Please remember to mark the replies as answers if they help, and unmark the answers if they provide no help. If you have feedback for TechNet Support, contact
[email protected]

How do i scan multiple pages into one pdf file

How do I scan multiple pages into one pdf file?

That depends on your scanning software. Adobe Reader doesn't scan.

Scanning pages into 1 PDF file

I have a Photosmart Plus B210 Series and a Mac OS X 10.6.6. My problem is that I want to scan more than one page in a single .pdf or .jpeg file and I cannot figure out how to do it. I can only scan one page per document. Anyone have a solution?

I'm not familiar with your model, but for my Photosmart D110, there is a check box after selecting Scan Document in the Solutions Center, then Scan at the bottom of the next window that specifies scanning each page into a different file. This box must be unchecked in order to create multi-page file.

Capturing EPC error List into a local file using BDC

Can anyone let me know the Code for downloading the EPC check Results into a local File using BDC...[<b></b>

You can use the function module
EXTENDED_PROGRAM_CHECK to get the errors and warnigs of a epc for a program.
then you can download that internal table information using GUI_DOWNLOAD fm.
Regards,
Ravi

I want to import a MS Word Index into a .pdf file using Adobe Pro. How do I do that?

I want to import a MS Word Index into a .pdf file using Adobe Pro. It is for a book. The book has been converted to a .pdf for printing, but it needs an Index for the last page of the book. I tried to embed a new index (starting from scratch but no luck. Any suggestions? Thank you for your time.

Now I want to search this "myArrayStrings.get(r)" in another file. How to do that?Store the returned String. Do the same thing you did to read the first file to read the second file (i.e. read it in line-by-line and store the lines in a list). Then check if that list contains the String you stored from the first list.
E.g. (using your code):
String name = myArrayStrings.get(r); // assuming r is initialized somewhere before this
if ( otherList.contains( name ) ) { // assuming otherList is your second list
// do something
}

How do i export my contacts into a csv file?

I need to export my contacts into a csv file - Apple support says it can't be done. Any suggestions anyone please?

or -> http://lmgtfy.com/?q=Mac+OS+export+contacts+to+CSV

Download a UNIX based CGI page into a CSV file using Powershell

Similar Messages

Maybe you are looking for