Client framework within SSIS to Access OData Remote Host

I need some advice on which direction to go regarding the best way to import data from an OData remote host to an mssql2012 instance. On average the data that I would need to import consists of 15 data objects, 8 of which require about 14,000 rows averaging
about 1,200 bytes per row. The other remaining objects average about 1/3 of that. This will execute about 4 times per day.
I have created an SSIS controller package using C# scripting with the System.Net.Http classes as a POC, which manages the thresholds and parallelism of accessing and writing the data. This was developed on the Visual Studio version 12 IDE, some of which
I made visible here: (Stackoverflow Code Review ) . The code works, however, there are timeouts that manifest as thread
drops/task cancellations, etc. during peak operational hours.
It is time for me to refactor this package in such a way, that it can be used as an OData pattern we can use in our shop going forward.  I am uncertain how to address this challenge. There are conflicting references online--some approaches lean toward
WCF, others point out newer asp.net OData assemblies, etc. I am unclear on Microsoft's direction regarding OData consumption of remote data. There is more published clarity on providing OData services as a provider for clients to consume.
The more ideas, thoughts, etc. that I hear from this community the better! :)

Arthur,
Yes, there have been timeout occurrences. I've addressed these by switching up asynch calls to bisynch calls where I wait for return communication--then manage the result accordingly.
I am doing all of the OData data retrieval and session management through c# tasks within SSIS as an http client to the remote host.
The OData component you and David mentioned is not included in this POC because I was unable to get it to connect to the 3rd party uri without throwing an xml parsing error on connect attempts. I was however, able to use the OData component in another SSIS
package connecting to Sharepoint as service documents. I don't have that option for the 3rd party objects.
This is less of a question and more of an open discussion. Faced with an OData component that isn't working in SSIS, what approach would you take?

Similar Messages

  • How do I access the remote(requesting) clients IP address through the Portal API?

    How can I access the remote(requesting) clients IP address through the Portal API?
    On our 4.5 - IIS system, we can acces it using the Request.ServerVariables("Remote_Addr") in the ASP pages.
    We are deploying 5.0 on Java Portal and would like to be able to do this through the Portal's API so I can call it in one of our custom login Activity space or control etc.
    I have looked documentation for the HTTPServletRequest object. It seems like we should be able to access it through one of the methods getRemoteAddr if we can get a handle to HTTPServletRequest object through the Plumtree's framework.
    I think the XPRequest object encapsulates the HTTPServletRequest but I didn't see getRemoteAddr method listed in the Javadocs.
    Is there a way to access the client's IP address through the Plumtree's framework?
    I need to do this so we know the location of the user and in our business case we have fixed IP adresss which let us identify which location is user accessign the system from. We can't do this through preferences or profile because we have to use generic userid for the specifc group of users.
    Any help on this would be appreciated.
    Thanks.
    Vanita

    Hi, Vanita. For now, you can use
    stringsClientIP = HttpContext.Current.Request.ServerVariables["REMOTE_ADDR"].ToString();
    Hope that helps!
    Sarah

  • (261936172) Q general How can I access an EJB hosted on a remote server?

    Q<general> How can I access an EJB hosted on a remote server?
    A<general> The ability to add EJB control files enables you to access an EJB that
    is deployed to the server on which your web service is running. When you select
    "add EJB control" you need to supply the home and remote interfaces for the EJB
    as well as the JNDI name. This does not provide you with the capability for creating
    a control for a remotely hosted EJB. To use a EJB hosted on another server you
    will have to provide the appropriate code within your web service itself. You
    will have to programmatically gain to access the JNDI for the remote server, lookup
    up the home stub and use it to create the remote stub for the EJB. Of course,
    to make this work you must have the necessary client interfaces in you classpath
    (home and remote interfaces) which can easliy be achieved by adding the EJB client.jar
    file to the lib directory in the webservice WEB-INF folder.

    just define the different server path in the description xml file
    <jndi-name>jnp://serverA(B)/....</jndi-name>

  • SFTP receiver error: putFile: Could not connect to remote host; Reason: Unable to open Sftp client. SshReasonCode: CHANNEL_FAILURE

    Hi,
    When we try to send file over seeburger SFTP (receiver) we are getting the error as below.
    Message processing failed. Cause: javax.resource.ResourceException: Fatal exception: javax.resource.ResourceException: >> Description: SFTP transaction error occured.>> Details: putFile: Could not connect to remote host; Reason: Unable to open Sftp client. SshReasonCode: CHANNEL_FAILURE>>SendingStatus: NOT_TRANSMITTED>>FaultCategory: COMMUNICATION_ERROR>>Retryable: true>>Fatal: true, >> Description: SFTP transaction error occured.>> Details: putFile: Could not connect to remote host; Reason: Unable to open Sftp client. SshReasonCode: CHANNEL_FAILURE>>SendingStatus: NOT_TRANSMITTED>>FaultCategory: COMMUNICATION_ERROR>>Retryable: true>>Fatal: true
    But we are able to connect through filezilla . we are able to create and delete file using the same username and password which is being used in SFTP adapter.
    we have imported the both dsa and rsa keys in SFTP partner folder in NWA. Even though we are getting same error.
    Thanks,
    Vinayak

    Hi Ram,
    we checked with network team and port 22 is open and they are able to ping to the target system.
    we checked the seeburger logs and we see EOF received from remote site error:
    Caused by: com.maverick.ssh.SshException: EOF received from remote side [Unknown cause]
    #at com.maverick.ssh2.TransportProtocol.b(Unknown Source)
    #at com.maverick.ssh2.TransportProtocol.i(Unknown Source)
    #at com.maverick.ssh2.TransportProtocol.nextMessage(Unknown Source)
    #at com.maverick.ssh.message.SshMessageRouter.d(Unknown Source)
    #at com.maverick.ssh.message.SshMessageRouter.access$000(Unknown Source)
    #at com.maverick.ssh.message.SshMessageRouter$_b.run(Unknown Source) 
    Thanks,
    Vinayak.

  • Web Access for Remote Desktop on Windows Server 2012

    Hello,
    i've a Windows Server 2012 without a domain. So i installed the remote desktop session host, the remote desktop license server and the remote desktop gateway as a server role only. All is working fine. Without a domain, no management tools for remote
    desktop are available. So i configure the remote desktop via the registry. I define (via registry) some remoteapps, too. All values are copied from a running Windows Server 2008 R2. So the remoteapps are runing.
    Now i want to use the new Microsoft Remote Desktop client for Android. To use a remoteapp i must define a remote resource. To define a remote resource i need a url to the web access for remote desktop. So i installed the web access. But if i login to the
    web access, i don't see any remoteapp. What's wrong? I've set the ShowInTSWA to 1. What must i do to access an existing remoteapp via web access?
    Martin

    Hi Martin,
    Server 2012 RD Web Access is designed to retrieve published RemoteApps and Desktops from a Server 2012 RD Connection Broker and/or a Server 2008 R2 RD Session Host server.  From your description it doesn't appear that you are using either of the above.
    I know it is a more complicated set up, but you should consider having a domain, creating a RDS deployment, etc., so that you can use the full featureset as it was intended.  You can do it all on a single server if needed.  For Server 2012
    there is a hotfix that needs to be applied to permit RD Connection Broker to work on the same server instance as active directory.
    -TP

  • Signed applet accessing remote host getting AccessControlException

    I'm fairly new to java development, so hopefully this is an easy answer, but in my searching I haven't yet been able to figure out why this isn't working for me.
    I have a self-signed applet, running on a server in my intranet. I understood that using a signed applet would allow connecting to any host within the applet. In the applet, I'm using the following code to try to connect to a remote host, which is also in my intranet:
    import org.apache.commons.net.ftp.*;
    FTPClient ftp = new FTPClient();ftp.connect("[myhost]");
    //Where [myhost] is the name of the host I'm trying to connect to.This works fine when running from Eclipse Applet Viewer, but when I run from the website, I get the prompt to accept the signature and run. I click run. When the code above runs, I get the following exception:
    ava.security.AccessControlException: access denied (java.net.SocketPermission cmdsp.bsu.edu resolve)
    at java.security.AccessControlContext.checkPermission(Unknown Source)
    at java.security.AccessController.checkPermission(Unknown Source)
    at java.lang.SecurityManager.checkPermission(Unknown Source)
    at java.lang.SecurityManager.checkConnect(Unknown Source)
    at sun.plugin2.applet.Applet2SecurityManager.checkConnect(Unknown Source)
    at java.net.InetAddress.getAllByName0(Unknown Source)
    at java.net.InetAddress.getAllByName(Unknown Source)
    at java.net.InetAddress.getAllByName(Unknown Source)
    at java.net.InetAddress.getByName(Unknown Source)
    at java.net.InetSocketAddress.<init>(Unknown Source)
    at java.net.Socket.<init>(Unknown Source)
    at org.apache.commons.net.DefaultSocketFactory.createSocket(DefaultSocketFactory.java:53)
    at org.apache.commons.net.SocketClient.connect(SocketClient.java:162)
    at org.apache.commons.net.SocketClient.connect(SocketClient.java:250)
    at Deploy.DeployCard(Deploy.java:150)
    Any help would be GREATLY appreciated.
    Thanks!
    Daryl

    Bonjour,
    J'ai le problème que celui énoncé dans ce topic. Je réalise une applet ftp qui doit se connecter à un serveur ftp. J'utilise org.apache.commons.ftp.net et mon appli fonctionne sous eclipse mais pas intégré sur une page web.
    J'ai signé le jar commons-net-1.1.4.jar et le jar qui contient mon code et ça ne fonctionne pas.
    dois-je mettre toutes les classes de commons-net-1.1.4.jar dans mon fichier jar, je ne sais pas comment faire pour inclure commons-net-1.1.4.jar dans mon jar car lorsque je compile, je met le path dans eclipse mais je n'ai normalement pas besoin de mettre le commons-net-1.1.4.jar dans mon jar car les classes sont automatiquement importées.
    Merci de votre aide

  • Connecting Access Databases remotely?

    Currently:
    Currently I have a Java application which performs all I wanted and the limitation in it is "It only resides on the Local machine for which it needs to work". I have the Microsoft Access Databases located on a Remote Server and I install the Java app on the remote server to connect the databases using a connectionString "jdbc:odbc:DRIVER={Microsoft Access Driver (*.mdb)}; DBQ=D:\DATA\DPPI\DATA\DPPI\DPPIPR01.mdb"; It connects to Access Databases and do all the bussiness logics with them.
    Enhancements (to be done):
    1. Making the application online - not a big issue.
    2. Connecting the databases remotely - its the only concern.
    So, if I make the Application Online the Access Databases need to be connecting through network (somewhat like ip or some web address).
    Problem:
    But after going through this http://stackoverflow.com/questions/11388277/connect-to-access-database-remotely, it seems my requirement can not be completed.
    Is there any way if I'm able to upload the database to the online web hosting server and access the database from there only? If yes, then how should I do the connectivity since Access Database connects by giving the fully qualified name containing drive letter and all. But how should I proceed further so that I may be able to connect the mdb Databases remotely?
    ADO .Net Solution:
    After going through the link:
    http://webcheatsheet.com/ASP/access_connection_strings.php , it seems we can perform remote Access Database connectivity.
    The solution for the ADO is something like:
    connectionString="Provider=MS Remote; Remote Server=http://your_remote_server_ip;" &_ "Remote Provider=Microsoft.Jet.OLEDB.4.0; Data Source=c:\your_database_name.mdb"
    I'm a tad confused to how Access Database we can connect.
    EDIT
    There is one more question in my head.
    I'm making use of Type-1 Driver. By making use of Type-4 Driver like HXTT Access(http://www.hxtt.com/access.html), a commercial type 4 driver for MS Access, supports it. But is there any open source Type-4 Driver like this?
    Edited by: Sanchit Java Dev on May 29, 2013 9:54 PM

    Thanks for your responses guys. It seems I'm heading in a right direction (but can't completely say as I would also like to be concerned about the performance issues.)
    For the time being I would like to consider this approach until it is fully confirmed.
    Please let me know if I'm proceeding in a right way? (developed a webservice using Jax-ws testing application)
         1. I wrote a Jax-ws webservice published and tested on the localhost - its returning the response (tested using Soap-Ui).
              So, I would like to have the same application to be acting as a Server to be deployed on the Server housing the Microsoft Access Databases. It would connect the database and return the result to be consumed from Client.
         2. From the other end I opened the Soap-Ui such that I edited the Endpoint like: (this call would be actually made from the Online Application)
              Previous End point of the Wsdl- http://localhost:8080/myService/services/Invoker - tried and tested
              Edited End point of the Wsdl for testing - http://remoteIp:8080/myService/services/Invoker
              I got the Error stating:
                                            ERROR:org.apache.http.conn.HttpHostConnectException: Connection to http://192.168.1.6:8080 refused.
         Please let me know what I'm doing wrong or is there a special requirements for calling the services remotely?
    EDIT
    I took the IP address by executing ipconfig.
    Edited by: Sanchit Java Dev on May 31, 2013 3:28 AM

  • Have to restart Lion server every time I want to access it remotely

    L.S.,
    My Mac Mini Server (10.7.3) is colocated at a data center.
    At this point I have to restart Lion server every time I want to access it remotely for screen sharing over the internet.
    I can make the connection, so all the right ports are open, as the port scan also shows, but it just times out when I wish to connect again within the same server without rebooting.
    I bought Apple Remote Desktop but that doesn't help either. I can still connect through AFP, web and VPN.
    I do hope that someone can give me some more insight in this problem.
    Rebooting isn't a problem by the way...
    UPDATE:
    If I keep the session active overnight, there is no problem whatsoever, but when I log off as a "good practice", which I've learned using Windows, screen sharing will not work any longer. Forgetting about logging off seems to be a viable workaround at this point .
    regards,
    Mark

    Double post... https://discussions.apple.com/message/17729558#17729558

  • Accessing a Remote Desktop

    I would like to access a remote desktop. Apple gives information on setting up your own remote desktop to be able to access the Mac but I need to use my Mac to access another remote desktop. Is this possible and if so, how?

    If you want to share the screen of another Mac, see:
    http://www.dummies.com/how-to/content/how-to-turn-on-screen-sharing-in-mac-os-x- lion.html
    If you want to access a Windows system, download Microsoft's Remote Desktop Connection Client for Mac.
    Regards.

  • I have an Ipad 2 and here is what I am trying to accomplish.  On my laptop I connect to a remote desktop connection to access a shared program we use for reporting.  How do I set up my Ipad to access this remote server?  Thanks for the help.

    I have an Ipad 2 and here is what I am trying to accomplish.  On my laptop I connect to a remote desktop connection to access a shared program we use for reporting.  How do I set up my Ipad to access this remote server?  Thanks for the help.

    Close ... before going for a specific Cisco app ... lets find out some details:
    Host we need more details:
    What is your server environment (Windows Server, or Mac OS X Server, or Linux)?
    What security is implemented in your environment - as what is restricted (RDP for all or specifc credentials on all machines? Are you part of local admin group to the server you wish to connect)?
    Does your environment Support CISCO IPSec connection? If so use Settings> VPN and IPSec tab to enter VPN details, if not then go with above suggestion. IF your restricted to RSA then either built in VPN settings or 3rd party app for RSA would suffice.
    Finally, there are many RDP applications out there I use "Mocha RDP Light" (free minimal ads when launched not when connecting).

  • How can I install a jre on client machines with no Internet Access

    Hi
    I have a lot of client machines located throughout the country which are connected to a central network (Oracle) application server. The client machines do not have internet access. The application now uses an applet which is accessible from the network. I would like to use the <jsp:plugin> tag to automatically download and install a jre on the client browsers that don't have a jre installed, when they access the jsp page. Unfortunately, even using iepluginurl="http://server-address/jinstall-1_4_2-windows-i586.cab, the client machines still need to access the internet to install the JRE as the cab file needs to access files at the Sun site.
    Is there any online jre installer, that can be used on a network where the client machines do not have internet access? Or do I need to install the JRE manually on each machine? The browsers are all Microsoft Internet Explorer.
    Thanks
    David

    Thanks for your reply ChuckBing.
    Unfortunately I had already copied the instructions I found in the Sun documentaion to the letter and it still needed access to the internet. In the end I solved the problem by pointing the iepluginurl to a non existent file and putting a URL, pointing to an offline JRE executable on the server, as the message that appears when the applet cannot be loaded. The clients then have the choice of downloading the JRE or installing it online by clicking on the URL.
    Thanks anyway.
    David

  • Can multiple PCs access one remote panel at the same time?

    I've written a program in labview 7.1 to monitor/control a labview application running in the test cell through Remote Panel. I and my coworker can remotely monitor and/or control this labview application individually. But if my coworker has the remote panel displayed on his PC and I try to get the remote panel on my PC, I get a labview error (63) as below:
    "LabVIEW:  Serial port receive buffer overflow.
    LabVIEW:  The network connection was refused by the server."
    My question is: Can multiple PCs access one remote panel at the same time?
    Thanks in advance!
    Y

    Sorry I wasn't clear. The remote panel license is separate from the number of LabVIEW development licenses. Pricing information on remote panel licenses can be found here.

  • Is it possible to use ICS with a Cisco VPN client to allow pass through access for Domain login for a second machine.

    I have a current machine Windows 7 Pro with a Cisco VPN 3.5v client that currently connects with access to a customers network.
    They shipped a second machine Windows 8.1 Pro without adding local accounts, that is pre-joined to a sub-domain the first system has access to.
    Would it be possible to use the first machine as a ICS or Router to allow the second machine to see or access for log in, without returning to the customer site and plugging in for a log in point?
    Trying to save a 3 to 4 hr trip and lugging a system back for myself and the rest of the team.
    Thanks

    Hi,
    Please refer to this part
    http://windows.microsoft.com/en-hk/windows/using-internet-connection-sharing#1TC=windows-7
    ICS and VPN connections
    If you create a virtual private network (VPN) connection on your  host computer to a corporate network and then enable  ICS on that connection, all Internet traffic is routed to the corporate network and all of the computers on your home network
    can access the corporate network. If you don't enable ICS on the VPN connection, other computers won't have access to the Internet or corporate network while the VPN connection is active on the host computer
    Yolanda Zhu
    TechNet Community Support

  • How can I determine what dns server the wifi client use within airport

    How can I determine what dns server the wifi client use within airport
    I want to use dns servers other then the one that airport extreme is using. For example I got the 172.16.1.1 (the default gateway - airport extreme), but I want to use the office dns servers, that are in a 10.x.x.x range.
    Is there a possibility?
    Thanks and happy eastern

    The Airport Extreme uses the DNS servers assigned by the network that it connects to. Is you Airport Extreme on the 10.x.x.x network? if it is then you are already using the 10.x.x.x DNS servers. Check your Airport Extreme with the Airport Utility and you will see in the Internet tab, the DNS servers used. The devices connecting to the Airport Extreme are assigned a DNS address of the Airport Extremes IP, In your case 172.16.1.1 but all DNS searches and resolution are done with the DNS servers you see in the Airport Extreme.
    If you want to use some other DNS then you can override in the Airport Extreme which will be used by all devices connecting too the Airport Extreme, Or you can edit the DNS address in each devices wireless settings.

  • How to access the remote Objects Without Db_links?

    Hi ,
    I want to know how to access the remote objects without db_link.That is i want to access a object in some other server which has different database.

    SanjayBala, just so you know that it is possible to create a database link in Oracle to non-Oracle databases in some circumstances. Look up Generic Connectivity aslo know as Heterogenous Services. With 11g Oracle has basically renamed the feature and replaced it with somethinkg named ike DG4ODBC.
    I have not spent time studying the details for DB4ODBC but with HS Oracle provided the interface and you had to obtain the necessary ODBC driver on your own. I had Oracle on AIX reading and writing to SQL Server on Windows but the developers chose to write a java program and connect to both via it. On Windows and Linux platforms the necessary ODBC drivers might be available without the requirement to go out and purchase one.
    The Oracle Open Gateway product is an advanced version of the above features with drivers for specific non-Oracle databases included like DB2 or Informix.
    HTH -- Mark D Powell --

Maybe you are looking for