Webservice as Data source in SSIS

Hi
I have a Scenario where Tibco webservice [ Which contains details of Contacts/Quotes etc., ] has to be consumed using
SSIS
kindly help me how to consume a webservice using SSIS and how the output of webservice can be stored ??
Finally i need to Migrate this pulled out data into MS Dynamics CRM 2013 Online version .
Any help is greatly appreciated on how to Migrate the Pulled out Data into Online CRM Using SSIS

- What i hope is you need customization of SSIS web service task which can accomodate CRM as well
- Divide into 2 parts
a - Get the output from webservice through the web service task
b - USe scripting to accomaodate CRM.
Quite deviating and opposed to above , an interesting one :http://ssis4crm.codeplex.com/
Happy to help! Thanks. Regards and good Wishes, Deepak. http://deepaksqlmsbusinessintelligence.blogspot.com/

Similar Messages

Using Oracle Data Source in SSIS using Attunity

Hi,
I am using the oracle data source in SSIS.
* Created the expression that will have query to select source column.
* I need to extract only rows having specific date. This date is a dynamic one i.e Created a variable1 which will be update by function call(return type is datetime) for time being i have assigned the
value(datetime type).
* I have created one more variable2(string type) which will extract only date(dd-mon-yyyy). Below is the query i used.
{"select cast(DATEPART(dd, @[User::Cob_Dt] )as char(2))+'-'+cast(DateName(mm,DATEPART(mm, @[User::Cob_Dt] )) as varchar(3))+'-'+cast(DATEPART( yyyy, @[User::Cob_Dt]
) as varchar(4)) "}
* In source query expression i have used the variable but it showing "as missing expression". Though i tried a lot i cant get. some one please help. Below is thquery
{select * from table_name where ud.system_date =@[User::Date]
and... }
I have tried different formats like enclosing that between quotes(shows same error), then used to_Date() in oracle again shows same error.
If i hard code the value instead of @[User::Date] means its working well.
SomeOne please help me why that error is showing. I cant able to figure out. trying for whole day. PLEASE.
Thanks,
Mahalakshmi
mahalakshmi

Directly in the source component, or in the expressions property of the data flow?
If the latter, what happens when you preview your expression?
MCSE SQL Server 2012 - Please mark posts as answered where appropriate.

Connecting to Oracle Data Source using SSIS

Hi Guys,
Please I am working on a BI Project that requires me to connect to an oracle data source using SSIS.
Can someone assist me with the required steps to achieve that.
I dont want to use a third party tool.
Thanks
me

Hi lilutchay,
If the SQL Server Integration Services is Enterprise or Developer edition of SQL Server 2008, we can use
Microsoft Connector Version 1.2 for Oracle to connect Oracle databases with version Oracle 9.2.0.4 or higher, Oracle 10.x or Oracle 11.x. If the SQL Server Integration Services is Enterprise or Developer edition of SQL Server 2012, we can use
Microsoft Connector Version 2.0 for Oracle to connect Oracle databases with version Oracle 9.2.0.4 or higher, Oracle 10.x or Oracle 11.x.
While if we want to connect to other Oracle version databases, we can use
OLE DB provider for Oracle which has been tested in SSIS labs and is recommended by Microsoft.
For the detail steps for Microsoft Connector for Oracle, we can refer to the first blog suggested by Deric. For more details about the use of connecting to oracle using Oracle Provider for OLEDB from SSIS, please refer to the blog below:
http://www.databasefun.com/archives/591
Reference:
SSIS with Oracle Connectors
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Using Webservice as data source in BI publisher data model

Hi All,
i want to expose data from share point through a webservice and use that webservice as a data source in Bi Publisher. But i am not able to use the webservice directly since it is a external web service.
For that i made below config changes. But it is causing weblogic server starting issues.
MW_HOME/user_projects/domains/DOMAIN_NAME/bin/
EXTRA_JAVA_PROPERTIES="-Dhttp.proxyHost=Hostname -Dhttp.proxyPort=80 -Dhttp.nonProxyHosts=localhost|hostname ${EXTRA_JAVA_PROPERTIES}"
export EXTRA_JAVA_PROPERTIES
EXTRA_JAVA_PROPERTIES="-Djavax.xml.soap.MessageFactory=oracle.j2ee.ws.saaj.soap.MessageFactoryImpl
-Djavax.xml.soap.SOAPFactory=oracle.j2ee.ws.saaj.SOAPFactoryImpl -Djavax.xml.soap.SOAPConnectionFactory=oracle.j2ee.ws.saaj.client.p2p.HttpSOAPConnectionFactory ${EXTRA_JAVA_PROPERTIES}"
export EXTRA_JAVA_PROPERTIES
Please let me know what i am doing is correct and suggest something.

i want to expose data from share point through a webservice and use that webservice as a data source in Bi Publisher. But i am not able to use the webservice directly since it is a external web service.
But i am not able to use the webservice directly since it is a external web service.
why?
look at "Creating a BI Publisher Report Based on External Web Services" ExternalWebServices
For that i made below config changes. But it is causing weblogic server starting issues.
why do you want to change some weblogic server settings?

Webservices as Data Source (10.1.3.4.1)

Tried to Use the Webservice
http://www.ignyte.com/webservices/ignyte.whatsshowing.webservice/moviefunctions.asmx?wsdl
as Data Source for testing
I can't find Webservice Drop Down Populated
Any Suggestions?

Hi robert,
Check these might be of help too http://www.oracle.com/webfolder/technetwork/tutorials/obe/fmw/bi/biee/r1013/essbase/biee_essbase.htm#t1
http://oraclebiblog.blogspot.com/2009/08/essbase-alias-tables-universal-language.html
Cheers,
KK

How to transform node name in XML data source for SSIS

I have the following xml file; I want to change the node name of Emp.location to Emp_location, Edu.location to Edu_location, Addr.location to Addr_location as it was not supported by SSIS. I have multiple files like that. I am thinking to use SSIS XML
task with XLST file to transform it. Can anybody help it?
Thank you
<?xml version="1.0" encoding="utf-8"?>
<Resumes>
<Resume>
<Name>
<Name.Prefix />
<Name.First>Shai</Name.First>
<Name.Middle />
<Name.Last>Bassli</Name.Last>
<Name.Suffix />
</Name>
<Skills>
I am an experienced and versatile machinist who can operate a range of machinery personally
as well as supervise the work of other machinists. I specialize in diagnostics and precision inspection, have expertise in reading blueprints, and am able to call on strong interpersonal and communication skills to guide the work of other production machinists
whose work I am called upon to inspect.
My degree in mechanical engineering affords me a better theoretical understanding and mathematical
background than many other candidates in the machinist trade.
</Skills>
<Employment>
<Emp.StartDate>2000-06-01Z</Emp.StartDate>
<Emp.EndDate>2002-09-30Z</Emp.EndDate>
<Emp.OrgName>Wingtip Toys</Emp.OrgName>
<Emp.JobTitle>Lead Machinist</Emp.JobTitle>
<Emp.Responsibility>
Supervised work of staff of four machinists. Coordinated all complex assembly and tooling
activities, including production of tricycles and wagons.
Developed parts fabrication from sample parts, drawings and verbal orders.Worked with
ISO9000 implementation.
</Emp.Responsibility>
<Emp.FunctionCategory>Production</Emp.FunctionCategory>
<Emp.IndustryCategory>Manufacturing</Emp.IndustryCategory>
<Emp.Location>
<Location>
<Loc.CountryRegion>US </Loc.CountryRegion>
<Loc.State>MI </Loc.State>
<Loc.City>Saginaw</Loc.City>
</Location>
</Emp.Location>
</Employment>
<Employment>
<Emp.StartDate>1996-11-15Z</Emp.StartDate>
<Emp.EndDate>2000-05-01Z</Emp.EndDate>
<Emp.OrgName>Blue Yonder Airlines</Emp.OrgName>
<Emp.JobTitle>Machinist</Emp.JobTitle>
<Emp.Responsibility>
Repaired and maintained a variety of production and fabrication machine tools.
Set up and operated machines to close tolerances. Used and wrote CNC machine programs.
Trained extensively in computer-aided manufacturing.
</Emp.Responsibility>
<Emp.FunctionCategory>Production</Emp.FunctionCategory>
<Emp.IndustryCategory>Manufacturing</Emp.IndustryCategory>
<Emp.Location>
<Location>
<Loc.CountryRegion>US </Loc.CountryRegion>
<Loc.State>IL </Loc.State>
<Loc.City>Chicago</Loc.City>
</Location>
</Emp.Location>
</Employment>
<Employment>
<Emp.StartDate>1994-06-10Z</Emp.StartDate>
<Emp.EndDate>1996-07-22Z</Emp.EndDate>
<Emp.OrgName>City Power and Light</Emp.OrgName>
<Emp.JobTitle>Assistant Machinist</Emp.JobTitle>
<Emp.Responsibility>
Performed centerless grinding. Received training in manual mill and lathe machines,
as well as micrometers and calipers.
Owned complete toolset.Worked extensive overtime on request.
</Emp.Responsibility>
<Emp.FunctionCategory>Production</Emp.FunctionCategory>
<Emp.IndustryCategory>Manufacturing</Emp.IndustryCategory>
<Emp.Location>
<Location>
<Loc.CountryRegion>US </Loc.CountryRegion>
<Loc.State>IA </Loc.State>
<Loc.City>Des Moines</Loc.City>
</Location>
</Emp.Location>
</Employment>
<Education>
<Edu.Level>Bachelor</Edu.Level>
<Edu.StartDate>1990-09-15Z</Edu.StartDate>
<Edu.EndDate>1994-05-10Z</Edu.EndDate>
<Edu.Degree>Bachelor of Science</Edu.Degree>
<Edu.Major>Mechanical Engineering</Edu.Major>
<Edu.Minor />
<Edu.GPA>3.2</Edu.GPA>
<Edu.GPAScale>4</Edu.GPAScale>
<Edu.School>Midwest State University</Edu.School>
<Edu.Location>
<Location>
<Loc.CountryRegion>US </Loc.CountryRegion>
<Loc.State>IA </Loc.State>
<Loc.City>Ames</Loc.City>
</Location>
</Edu.Location>
</Education>
<Address>
<Addr.Type>Home</Addr.Type>
<Addr.Street>567 3rd Ave</Addr.Street>
<Addr.Location>
<Location>
<Loc.CountryRegion>US </Loc.CountryRegion>
<Loc.State>MI </Loc.State>
<Loc.City>Saginaw</Loc.City>
</Location>
</Addr.Location>
<Addr.PostalCode>53900</Addr.PostalCode>
<Addr.Telephone>
<Telephone>
<Tel.Type>Voice</Tel.Type>
<Tel.IntlCode>1</Tel.IntlCode>
<Tel.AreaCode>276</Tel.AreaCode>
<Tel.Number>555-0114</Tel.Number>
</Telephone>
<Telephone>
<Tel.Type>Fax</Tel.Type>
<Tel.IntlCode>1</Tel.IntlCode>
<Tel.AreaCode>276</Tel.AreaCode>
<Tel.Number>555-0132</Tel.Number>
</Telephone>
</Addr.Telephone>
</Address>
<EMail>[email protected]</EMail>
<WebSite />
</Resume>
</Resumes>

See if these posts help: http://blogs.msdn.com/b/mattm/archive/2007/12/15/xml-source-making-things-easier-with-xslt.aspx
http://simonlv.blogspot.ca/2012/08/ssis-step-by-step-6-use-xslt-to.html
Arthur My Blog

.xlsm as Data Source in SSIS

Hi,
I have 6 files with extension .xlsm (macro). How to import the data from these files using SSIS to a sql table ?
I have these 6 files in 6 different folders in the same path, How do i call them in the ssis ?
Thanks in Advance

see
http://devinknightsql.com/2012/06/29/using-excel-macro-xlsm-enabled-files-in-ssis/
For getting files from folders you can add a file system task to move files to a common folder you setup. You may need a loop here to loop through folders and move the file .
You can use either of thr below
1. Use ForEach loop with Item enumerator and specify folder paths inside
2. If you want to make it dynamic create a table with path values and load a object variable with the list and then make ForEach loop iterate through it by using ADO enumerator
Once thats done you can add a ForEachLoop to iterate through the files and do the data transfer is add a data flow task inside loop as per above link.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Microsoft Online Services Authentication option disabled in the OData Data Source for SSIS

I am attempting to use the new OData source for SQL Server 2012 (
http://www.microsoft.com/en-us/download/details.aspx?id=42280)
to access SharePoint Online data. I should be able to do so by selection the "Microsoft Online Services Authentication" option, but it seems to be disabled. Does anyone know how to enable it?
Cheers
John

Hi John,
Glad to hear that you have resolved the issue by yourself. Thank you for sharing your valuable blog.
Regards,
Mike Yin
If you have any feedback on our support, please click
here
Mike Yin
TechNet Community Support

WebService Pluggable Data Source - When there is no proxy...

Hi there,
I'm trying to set up a report using the Webservice PDS, and keep getting errors.
(I'm using Dev Suite 10g, Report Builder 10.1.2.0.2 on WinXP SP3)
http://www.oracle.com/technology/products/reports/pluginxchange/index.html
I believe that my setup is OK, I've followed the directions from here:
http://www.oracle.com/technology/products/reports/pluginxchange/plugins/datasource/webservicePDS/readme.html
ie:
the soap.jar, WsPDS.jar and jdev-rt.jar files are all present in C:\Frs1002\reports\jlib
All three files and the above location are in my REPORTS_CLASSPATH registry setting.
I've also added in the line to my cauprefs.ora file as required:
"oracle.reports.plugin.datasource.wspds.WSDataSourceFactory",
But...
The webservice that I'm trying to access is external to my network, however I don't use a proxy - I use a gateway to access the net.
As such, I've attempted to put my gateway address into the proxyinfo.xml file, and then enabled the proxyinfo in the bottom of the rwbuilder.conf file, but then when I run report builder and use the wizard; like in the Oracle given example, I get an error when clicking 'Query Definition': "WSPDS-100: Error while Extracting Config File! null."
I don't have a config file for WSPDS, only the jar files that were with the installation zip. Am I missing something?
If I remove the information from proxyinfo.xml and change the rwbuilder.conf back to the way it was, I don't get the error, but when I put in the URL for the WSDL document, when I click next, nothing happens.
(I've checked the WSDL link - it's fine.)
Am I missing a wspds.conf file?
Do I put in something else in the proxyinfo.xml file instead of my gateway?
Any assistance or suggestions appreciated.
Ron.

Hi Deepti,
3 should work (for weeks > 43). Please open a customer message so SAP support can analyze the issue.
Regards,
Marc
SAP NetWeaver RIG

Using Web Service as Data source (Pluggable Data Source) in Oracle Reports

Anyone using Webservice as a pluggable data source in oracle 10g reports.(Report builder version:10.1.2.0.2)? We need to be able to use web service as one of the data source to create reports.Tried the following and ran into issues:
Imported the wspds.jar fle from oracle plugin exchage. When tried using it received the following error in oracle reports trace file.
04/26 22:27:22 java.lang.NoSuchMethodError: oracle.xml.parser.schema.XSDBuilder.build([Loracle/xml/parser/v2/XMLDocument;Ljava/net/URL;)Ljava/lang/Object;
By troubleshooting issue found out that xmlparserv2.jar in 10g is newer than xmlparserv2.jar in 9i. wspds.jar is using xmlparserv2.jar in 9i as it was developed and tested for 9i only. Believe there is no newer wspds.jar file developed specifically for 10g?
Is there a better/standard solution to use webservice as data source in oracle 10g reports? Does later version of oracle reports supports webservice as a data source without any additional plugins? Any suggestion would be helpful.

Please provide support for the above request.
It appears that Oracle 10g reports doesn't support Web Service as pluggable data source. Is this option is available in Oracle 11g Reports or Oracle Discoverer Or OBIEE?

How to use web service as data source for forge or endeca ?

hi,
is there any way to use webservice as data source in pipeline ?
i have requirment to get data from web service and dump it in endeca. for this i need some idea on how can be this achieved. is it possible to do so?

Crawling is part of the CAS, which is kind of the data ingest process in Endeca as you would know. There are a bunch of OOTB Crawlers available like FileSystem based, XML Crawlers, etc., and there could be a case where you have to write your own and thats what I am suggesting because the XML crawl thats OOTB expects a specific format which isnt really mentioned in the Documentation. Please refer to CASDevGuide for more information. CAS, PlatformServices and ToolsAndFrameworks should be running when you start off with Endeca, you can see that from
ps -ef | grep java
on your machine

Strange - oledb data source preview shows results, but running results in 0 records

So I have this as a command of a OLEDB source, and the preview shows a sample result set. Mappings are correct, builds with no errors etc. Works fine in SSMS. However, when I run this Dataflow task in SSIS, I get NOTHING. Huh?
Here is the query
DECLARE @StartTime datetime,@EndTime DATETIME, @ExecTimeMS INT
SELECT @StartTime=GETDATE()
DECLARE @t TABLE (tval NVARCHAR(30) )
INSERT INTO @t SELECT TOP 10 t.control_number FROM MyBigTable t
SELECT @EndTime=GETDATE()
SELECT @ExecTimeMS = DATEDIFF(ms,@StartTime,@EndTime)
SELECT CAST('Top10LogBigTSelect' as NVARCHAR(100)) as query_name,@ExecTimeMS as exec_time_ms, GETDATE() as record_date

Found my answer here
http://saysmymind.wordpress.com/2013/04/11/ole-db-data-source-in-ssis-returning-no-records-when-using-table-variable/
The catch was to use NOCOUNT

How to find all uses of data source views in an SSIS solution

I am upgrading Visual Studio from 2008 to 2013 (with SSDT) and SQL Server 2008 R2 to 2012. I have a solution with over 30 dstx files. Each file has multiple OLE data sources and lookup tasks. There is inconsistent usage of data source views
throughout (as compared to SQL queries or table references). It is my understanding that all data source views need to be removed before upgrading SSIS packages from BIDS to SSDT. I tried searching the files as XML for the DSVs but it appears the
GUID reference changes per dstx file. It seems like I will have to look at each source/lookup. Is there quicker way to search for where they are used?
Thanks
Adding this question here. Posted question incorrectly in VSO forum.

All right, yes, they are dropped
Never upgraded a package that had them.
What happens if you just upgrade leaving a copy?
Arthur My Blog
This ended up being what I did for many of the packages. Upgrading the packages severed the data source views and left the SQL in the related tasks (e.g. OLE Source task). Sorry for the delayed mark as answered.

SSIS XML Data Source - worked in BIDS, can't read XML in SSDT

I have an SSIS 2008 package built in BIDS (2008) that uses a series of XML locations (similar to
http://corpslocks.usace.army.mil/lpwb/xml.tonnage?in_river=AG&in_lock=42&in_mon_yr=092013) to get tonnage information and load it into a SQL Server 2008 R2 database. This has been running daily without error for over 60 days. I am now migrating
this to SSIS 2012 using SQL Server Data Tools and I am having difficulty reading the XML into the database.
The package does the following (it is pretty simple):
1. read the URLs (there are 200) from a database view into a variable object
2. a for each loop container that loops through the variable object, gets the data from each URL (the XML URL is stored as a variable) and loads it into the database
The BIDS package still works great. I first used the converter to migrate to 2012. I then recreated a package with exactly the same settings as BIDS. No dice either way. I also tried using a local xsd file, then using one inline. SSDT will recognize all
of the columns correctly when I use inline, but neither method is capable of reading the data into a table.
I know the package is going to the addresses, all of the URLs show up in the error logs. The error messages are as follows: "[Load data from tonnage url [47]] Error: The file "http://corpslocks.usace.army.mil/lpwb/xml.tonnage?in_river=AG&in_lock=42&in_mon_yr=092013"
was not found. Please verify the file path and try again."
Has anyone run into this and solved it? I think I have tried every possible setting available, with no luck. Any ideas or suggestions are appreciated. Thanks!

I have an update on this issue. I believe it is a connectivity issue or possibly a setting in SSDT.
I can access the remote XML file location through my browser. I have downloaded the XML from the remote location and my package runs using the local XML file perfectly. I have BIDS 2008 installed on the same machine and it works without a problem (using
the remote XML location). This last piece makes me think there is a network setting or something in SSDT.
Does anyone have any additional troubleshooting advice or other suggestions? My error output is included below.
Thanks!
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Error: 0xC020F440 at Data Flow Task, XML Source [31]: The file "http://corpslocks.usace.army.mil/lpwb/xml.lockqueue?in_river=GI&in_lock=01" was not found. Please verify the file path and try again.
Error: 0xC02090D0 at Data Flow Task, XML Source [31]: The XML Source was unable to read the XML data.
Error: 0xC0047019 at Data Flow Task, SSIS.Pipeline: XML Source failed the prepare phase and returned error code 0xC02090D0.
Information: 0x4004300B at Data Flow Task, SSIS.Pipeline: "ADO NET Destination" wrote 0 rows.
Information: 0x40043009 at Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Data Flow Task

Webservice Data Source is Not Overwriting after Transport

Hi,
I have a Webservice Data Source which is loading XML based Data to DSO & Then to Infocube.
In development I it is working fine even Loading Delta perfectly. Then moved it production.
Again due to some client request I have made changes in Web Service Data Source & DSO & Infocube.It is also worked fine in Development. Again moved to production.
But after moving to production all objercts of DSO/Infocube changes are fine. Even Transformation/DTP is as it is with Development for upload from DSO To Infocube.
Issue : The New Webservice datasource is not overwriting Old one, same also applies Transforamtion/DTP too.
I need How to Overwrite it Datasource/Transforamation/DTP with new objects of same in Development.
Please suggest.
Regards,
Subhadarshi

Hello Prem,
I think you might be working on BI 7.0 and this datasource you are talking of is a 3.x datasource?
I have observed that when we activate a 3.x datasource in 7.0 system and replicate it in BI, it shows a modified status, but when you create a dataflow above it it becomes active. I think the datasource you have sent to production has no dataflow above it. Send the dataflow above transports for the datasource and it will get activated.
Please let me know if you need any more information.
Regards,
Pankaj

Webservice as Data source in SSIS

Similar Messages

Maybe you are looking for