DWLoader works in SSIS Execution Process Task?

Does anyone knows if PDW's DWLoader works in SSIS Execution Process Task? Is there a sample?
I struggle to find documentation on using DWLoader.exe in Execution Process Task (EPT) of SSIS. There are articles in PDW BOL about DWLoader.exe or SSIS to load data, however, there is no article I
can find about using DWLoader.exe in Execution Process Task SSIS. I'd expect SSIS to behave the same way as we execute it in Command Prompt.
A working (dwloader.exe) command string when putting to run in [Execution Process Task] in SSIS failed and it is hard to trap the errors. Tried writing the error out in my command string, as well as setting the StandardErrorVariable of the task, neither
one caught the details about the error. I also put the same command string in a bat file and then ran it, it worked. I then used EPT to run my bat, that actually succeeded. (That indicated to me Execution Process Task might have interpreted my string differently).

Hi there,
I am trying to use the dwloader utility to load data into a PDW database. I have created a batch file with the following syntax:
dwloader.exe -M fastappend -m -i "D:\SS\DATA_LOAD.txt" -T BATCH_V0.dbo.ATC_LOAD_TBL -R "D:\SS\LoadErrors_ATC.bad" -t "|" -r "\r\n" "yyyy-MM-dd HH:mm:ss.fff" -E -S 10.11.12.13 -U ATC_Login -P Password > "D:\SS\Error.log"
But the execution fails everytime. The error log gets generated but its empty. Can someone help me with the syntax? Am I missing something here?
Thanks in advance,

Similar Messages

Error while calling pscp.exe through a batch file which is called in SSIS Execute Process Task

Hi,
I am using Windows Server 2012 R2 Standard, SSIS 2012. I am trying to copy files from a remote location by calling pscp.exe through a batch file (FileCopy.bat at location M:\bin\) which is referenced in a SSIS Execute Process Task. My batch file content
is,
ECHO OFF
echo. >> M:\Prod\bin\SourceFile_FileLog.txt
echo %date% - %time% - Copy Start (XYZ_a201211155952avx0_69999.NOR.gz) >> M:\Prod\bin\SourceFile_FileLog.txt
M:\ProdFiles\bin\pscp.exe -unsafe -scp -pw aaaaa myuser@sourceserver:/ABC_data/*.NOR.gz M:\Prod\FromMediation\
echo %date% - %time% - Copy Complete >> M:\Prod\bin\SourceFile_FileLog.txt
The error I am getting is
[Execute Process Task] Error: In Executing "M:\bin\FileCopy.bat" "" at "", The process exit code was "1" while the expected was "0".
Exactly same setup but using Windows Server 2003 R2 Enterprise and SSIS 2005, this works fine and copies the files successfully.
Please provide some guidance on this.
Thank you!
'In Persuit of Happiness' and ..... learning SQL.

Hi,
This is what I am getting while running the batch file from command prompt
M:\bin\mttrb1>CDR_FileCopy
M:\bin\mttrb1>ECHO OFF
The system cannot find the path specified.
The system cannot find the path specified.
scp: M:\Prod\FromMediation\: Cannot create file
scp: M:\Prod\FromMediation\: Cannot create file
scp: M:\Prod\FromMediation\: Cannot create file
The system cannot find the path specified.
'In Persuit of Happiness' and ..... learning SQL.

How to execute SQOOP.cmd file from SSIS execute process task?

How to execute SQOOP.cmd file from SSIS execute process task?
What is argument need to be prefixed in the arguments property
Executable: C:\Hadoop\sqoop-1.4.2\bin\sqoop.cmd
Arguments: /C "sqoop import -connect "jdbc:sqlserver://mysystem:1433;database=test;username=myuser;password=mypwd;" -table emp -target-dir /user/emptable -m 1"
Thanks
Durga

Hi Durga,
SQOOP.cmd must be no different than any other .cmd/.bat I assume, your question is more about setting the parameters up I guessed.
So unless the arguments change dynamically you can call SQOOP.cmd from yet another .cmd that has its parameters passed to it and the former you simply set to run without the arguments in Execute Process Task.
Otherwise, in general to set a bat/cmd file to run in SSIS one needs to do this:
PS: It is a good idea to populate the working directory with the path to the .cmd
Arthur My Blog

SSIS-Execute Process task Error in 2012 version _File/Process "\\Servername\Foldername\batfile.bat" is not in path

Hi Sir,
I have develop the SSIS Package in 2012 version and i am calling the SSIS Package using Stored Procedure according to my requirement and that stored procedure will be using in my SSRS report Datasource.
once after the SSIS Pacakge has design and develop and deploy into the server as Project Deployment model..when i run the ssis Package ,calling through the SP it is working fine...
even when i design a SSRS report using SSDT(sql server data tools), in the SSRS reprot calling the above SP in Dataset.when i execute the SSRS report it is wroking fine...
once SSRS report has been deployed into the remote Server.. when i Execute the SSRS report i am getting the below Error message:
SSIS-Execute Process task Error _File/Process "\\Servername\Foldername\batfile.bat" is not in path
belo is the SP for calling the SSIS package.
DECLARE @EXECUTION_ID BIGINT,
        @PKG_RESULT INT
EXEC [SSISDB].[CATALOG].[CREATE_EXECUTION] @PACKAGE_NAME=N'abc.DTSX',
                                           @EXECUTION_ID=@EXECUTION_ID
OUTPUT,
                                           @FOLDER_NAME=N'aa',
                                           @PROJECT_NAME=N'xxx',
                                           @USE32BITRUNTIME=FALSE,
                                           @REFERENCE_ID=29 --unique identifier for environment
EXEC [SSISDB].[CATALOG].[START_EXECUTION] @EXECUTION_ID

Where the BAT part is ?
It looks like a security issue.
The account running has no permission apparently over "\\Servername\Foldername\batfile.bat"
Arthur My Blog

Calling Winrar.exe from Execution Process Task by Passing Arguments

Is any body having knowledge please let me know how to pass the arguments to winrar .exe to create a zip file from the Execution Process Task in SSIS

Should be something like:
unrar x c:\yourfile.rar *.gif c:\extractfolder\
Executable: C:\Program Files\WinRAR\unrar.exe
Arguments: x c:\yourfile.rar *.gif c:\extractfolder\
Please mark the post as answered if it answers your question | My SSIS Blog:
http://microsoft-ssis.blogspot.com |
Twitter

Ssis execute process task error: process exit code was 1 while the expected was 0

Hi Sir,
in my SSIS Package(2012) i am using Execute Process Task which will call bat file. bat file is located on UNC Path.i am having the below script in the batch file.
del \\servername\foldername\name.txt
rcmd \\servername D:\name1.bat
del \\servername\foldername\name2.txt
xcopy \\servername\foldername\file.txt \\server\foldername\outfilefolder
i am getting the below error message:
ssis execute process task error: process exit code was 1 while the expected was 0
i want know at what cases error exit code was 1?
Thanks for your time.

Hi prasad.alm,
The error is generic and can be caused by various factors. Here are some suggestions for your reference:
Manually run the executable to execute the batch file so that we can check whether the command lines in the batch file are correct or not.
Check there are no duplicate/existing files in the destination folder.
Try to run the package in 32-bit or 64-bit runtime mode.
If the issue occurs when running a job, try to create a CmdExec type job step to call the excutable. If this job also fails, it might be an issue between executable and SQL Server Agent rather than the SSIS package itself.
If the issue persists, enable logging for the package, and check if we can obtain more detailed error message for further analysis.
Regards,
Mike Yin
TechNet Community Support

SSIS Execute Process Task to Unzip Remote Files

I have created an SSIS Execute Process Task to unzip files on a remote server.
Executable: \\servername\c$\Program Files (x86)\7-Zip\7z.exe
Arguments: -o\\servername\d$\DBFiles\ -y x \\servername\d$\DBFiles\somefile.zip
The zip file size is about 40MB.
The SSIS task runs very slowly, close to 5 minutes. I know it should not take this long. When I remote logon to the server and run the 7z program to unzip the same file, it unzips in less than 10 seconds.
It seems that the way it is set up now, it constantly sending instructions back and forth from my PC to the server when I run the SSIS package on my PC.
I have 50 files of varying sizes that need to be processed daily. The SSIS unzip task takes 2 hours just to unzip these files.
How should I set up the SSIS Execute Process Task so that it can unzip files on remote server efficiently?
Many thanks in advance

The reason is that the files contain data that need to be loaded to the database. So, the zipped data files are copied to the server where the database lives. The SSIS package unzips the files and loads the database. The SSIS package is stored on the same
server. The server lives in the remote data centre.
My team run the SSIS package using Managament Studio running their PCs in the office, which is a different location to the data centre.
Since the package and files live on the same remote server, I would have thought that that would not be an issue. But the fact that we run the package locally means that the package is executed locally.
My goal is to put the zipped data files on the server, unzip the files, load data to a database on a remote server. I need to allow my team of 4 to be able to use Management Studio to run the SSIS packages to do the above. Would I be better off Remote
Desktop connecting to the server and execute the package there?
I will check out the PowerShell option.

SSIS Execute Process Task DDE/OLE

I have a package that executes an executable via Execute Process task, and that executable needs Adobe Reader to work. It sends PDF faxes to Adobe which converts them to tiff. This is a third party executable that is part of an enterprise Fax
Server so I have no control over changing the process at all. This being said, for whatever reason, it wont run as a SQL job. When the executable runs, it is passed a file name. It (the EXE) opens Adobe via DDE/OLE, not sure, it just launches
it, and covnverts/sends the fax.
It runs under BIDS with my authority, it runs under BIDS with SQLADMIN authority
It runs as a "deployed" package (right click choose run job) under the same authority as the SQL job is (SQLADMIN)
It runs from the command line with DTEXEC
When executed as a JOB, calling the DTSX from the catalog, it does not throw an error, but through debugging, we've found it stops at the executable, because the executable can't launch the Adobe instance. It continues to run and never fail, but not do
anything.
Is there something in SSIS (2012) that I need to configure to allow this to work?.
Thanks!!

Unfortunately, the Proxy didn't help. I had made one before, but I followed the article just in case I had done something incorrect. To summarize, the package calls an execute process task which runs a program called SendFax,exe and passes it
a filename. SendFax.exe internally instantates Adobe Reader and uses it for conversion from PDF to TIF. Outside of the SQL Agent job it runs fine. When launched by the Agent, it fails to instantate Adobe.
Also, when the dtsx is run from the command line using DTEXEC it runs fine. Putting the command line in a batch file and double clicking it, it runs fine. Executing that same batch file with "Highest permissions" in Windows Task Manager, it fails
as well.
Finally, I made a simple SSIS to launch AcroReader32 (in a 32 bit instance) in SSIS but putting out an execute process task that does nothing but launch Adobe, it fails. I remove Adobe 11 and installed 10.1, it still fails. I turned off all the security
in Adobe reader I could find, and it still fails.
This is making me crazy.....

SSIS execute process task error on unziping

Hi
I am using 7zip to unzip files in SSIS using execute process task. Here is the configuration of the task:
executable: C:\Program Files\7-Zip\7z.exe
arguments: e default-o\\servername\livechat\unzip\
However, on executing package in BIDS, following error is thrown
[Execute Process Task] Error: In Executing "C:\Program Files\7-Zip\7z.exe" "e \\servername\livechat\7566_20121009.zip-o\\servername\livechat\unzip\" at "", The process exit code was "2" while the expected was "0".
Can someone help where I made mistake?
Thanks,
hsbal

I have mapped the share to F: and then tested. Unfortunately that doesnt work as well.
I am getting the following error:
[Execute Process Task] Error: In Executing "C:\Program Files\7-Zip\7z.exe" " F:\*.zip -o F:\unzip" at "", The process exit code was "7" while the expected was "0".
Thanks,
hsbal
Seems like a syntax error. Go through this
http://www.dotnetperls.com/7-zip-examples
Rajkumar

SSIS-Execute Process task Error _File/Process "\\Servername\Foldername\batfile.bat" is not in path

Hi Sir,
I have designed the SSIS Package in 2012 Version. and i have deployed into the Integration Server,using Project Deployment Model.
In the SSIS Pacakge we are calling the batch file using Execute Process task.
when i am Executing the SSIS pacakge using Visual Studio(Sql Server Data tools) which is working fine.
When i Execute the Pacakge uisng Sql server Management Studio,after the Deployment i am getting the below Error message.
ExecProcess task:Error: File/Process "\\Servername\Foldername\batfile.bat" is not in path.
Thanks for your time.
Regards
Prasad

Hi Prasad,
When you say executing the package in SSMS, I think you right click on the package and execute it manually rather than execute it through SQL Server Agent job, right? How did you execute the package from the SSMS on DEV server? Have your also deployed the
SSIS project to the SSISDB catalog on DEV server or you used SSMS tool on DEV to connect to the QA server to execute the package?
When you log into the Database Engine instance, make sure the credentials you used has access on the shared folder which hosts the .bat file. Besides, I think the issue may be caused by the Windows UAC feature which may lower the permissions level of an
administrator to a standard user. So, I suggest that you run the SSMS as administrator to see if it works.
Regards,
Mike Yin
TechNet Community Support

NOT able to call exe in ssis execute process task

I am creating an SSIS package in which we execute an exe file from the EXECUTE PROCESS COMPONENT which contains the logics and uses few sp’s which checks the expiry dates of the certificates of some URL's. But when we keep the file on sever and run it through
TWS it is showing the error "FILE NOT IN PATH" .But if we keep the exe file in local path then it executes through TWS. If we run the package locally without TWS then it runs successfully no matter if the exe is in local path or placed in a shared
server folder. So i want to know is there any constraints in running the EXE file from the shared folder through TWS.
Note:
1.TWS- IBM Tivoli workload scheduler to call and execute ssis packages
2. TWS is install in different server (Like server A)
3. SSIS package and exe file located in different server (Like server B)
4. We are using dynamic path in SSIS package to locate SSIS package and exe file.

Hi SR_MCTS,
According to your description, a package that execute an exe file with Execute Process Task can be executed successfully without using TWS or the exe file stores in local path with TWS. While it fails when use TWS to execute the package with the exe file
stores in shared folder.
If in this scenario, it seems that the logon user that use TWS to execute the package has no access to the shared folder. We can logon as the relevant account or change some relevant settings on TWS to make sure the user has access to shared folder which
hosts the exe file.
Besides, since I’m not familiar with TWS, I’m not sure whether the issue is caused by there are some constraints in running the exe file from the shared folder through TWS. As to this issue about TWS, I suggest you post the question in the following forum:
https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000002658&tags=tws. It is appropriate and more experts will assist you.
Thank you for your understanding.
Regards,
Katherine Xiong
Katherine Xiong
TechNet Community Support

PDW : DWLoader in Execute Process Task, Success Value return code

Hi,
I'm using SSIS Execute Process Task to call DWLoader.
It seems the Success Value return code is 2.
Which is working fine except that after all data are loaded in my table a 0 return code is sent.
And so my task fails.
Any idea how to handle this ?
Thx for your help !
Regards,
Bertrandr

My understanding is - When DWLoader process returns 2, everything goes fine but in another case it returns 0 then task fails.
You can Set: FailTaskIfReturnCodeIsNotSuccessValue
to FALSE so that task will not care about return values
But in case of any other error such as syntax - save
error in MyVariable and verify if MyVariable != ""
-Vaibhav Chaudhari

Execute process task argument is not working for sph file and ogr2ogr.exe

Hi All,
I am trying to load shape file into a sql spatial table. A execution process task is used to run the ogr2ogr.exe program.
This is how the process tab looks like .
Executable : C:\gdal_ogr2ogr\bin\gdal\apps\ogr2ogr.exe
Argument : -f MSSQLSpatial MSSQL:server=SQL-ABC-DEV;database=MYSIMPLE_Dev;Trusted_Connection=True;\\mypath\files\shares\Data\www.mypage.htm\my_sample_file.shp
Success value : 1 (I am not sure why I need to change this value from 0 to 1.
For above settings, package runs fine. However the spatial table is not created always. It is created once in a while after switching Success value from 1 to 0 and 0 to 1 again. (After the spatial table is created, it is dropped using a execute sql statement).
I am running this in VS 2012.I saw in an article that we need to convert shp file to csv before we load it into sql server.I even tried to convert shp to csv using execute sql task and ogr2ogr.exe. Still the package runs successfully after changing Success
value from 0 to 1 but no csv file is created. If the success value is 0, it throws the following error.
[Execute Process Task] Error: In Executing "C:\gdal_ogr2ogr\bin\gdal\apps\ogr2ogr.exe" " -f CSV \\xxxxxxxxr.rdn\files\shares\xxx_Data\ImportData\www.xxxxxxx.hapepage.htm\xxxxxx\Watches\Warnings\myfile\CSV \\xxxxxxxxr.rdn\files\shares\xxx_Data\ImportData\www.xxxxxxx.hapepage.htm\xxxxxx\Watches\Warnings\myfiles\www.shp"
at "", The process exit code was "1" while the expected was "0".
Could long file name be a problem too?
Thanks for your help in advance..
shamen

Hello shamen,
Seems to me you are missing a step to check if the shape is there and purge it before loading if so.
Arthur My Blog

Pass Passord Variable to a Batch File using Execute Process Task

I have an FTP batch file that I want to execute using Execute Process Task. The content of the ftp (ftpscript.cmd) is as below:
open ftpsite
UserName
Password
ASCII
get file c:\temp\test.txt
bye
Using SSIS Execute process task, I was able to download data. I configured the Execute Process task as follows:
Executable: ftp.exe
Arguments: -s:"c:\temp\ftpscript.cmd"
The above works fine. But the problem is that I don't want to store the password value in the batch file for security/policy reasons. Please, is there a way I can pass the password value to the ftp executable or the batch file at run time?
I know how to get and store variables in SSIS but I don't know how to pass this kind of variable to the batch file just before execution.
Any suggestions will be appreciated. Thanks.

you can dynamically generate the source (CMD) for the FTP and delete after the execution. The password can be stored in a secure database for example, not 100 % secure, but the best you can do.
Another option I did was an encrypted VBScript (also quite easy to open in plain text to some people).
Finally it can be a binary e.g. an EXE with the FTP called as process in it.
Arthur My Blog

Execute Process Task Error - Powershell script

I've got a powershell script that is executed through a Execute Process Task that is giving me an error when executed through the Execute Package Utility on a 64bit server.
"c:\windows\system32\windowspowershell\v1.0\powershell.exe" ""& 'C:\CubeArchive\Linked DB to XMLA.ps1'"" at "", The process exit code was "1" while the expected was "0".
Here's the rub:
It runs fine from Visual Studio on that server.
On my local maching (32bit), it runs fine from both Visual Studio and Execute package Utility.
Does anyone have any idea why this is happening?
Thanks,
Jason

Ok - found the problem.
This is the first time that I'm using powershell.
I had set the ExecutionPolicy on that machine to unrestricted from the powershell console beforehand.
But unknown to me, this setting was only applicable to the 32 bit environment.
I set the 64 bit environment to unrestricted and it worked. (I added another Execution Process Task to the package to set this before hand - I only did this once and now can remove it.)
I thought that the setting for powershell would be server wide, I didn't know that there was a distinction of the 32 bit and 64 bit environments.
Thanks,
Jason

DWLoader works in SSIS Execution Process Task?

Similar Messages

Maybe you are looking for