Data refresh on dev instance

Hello:
I have a stage instance and a dev instance.There are around 15 schemas each having around 20 tables. I want to populate dev instance with following conditions:
a) Some tables have to be imported to Dev instance as they are in stage instance
b) Some tables have to be imported to Dev instance after scrambling the data
c) Some table have to be imported to Dev instance without any data.
d) Some table have to be imported to Dev instance with partial data.
Please let me know what should be the approach for this.
My email id is [email protected]
Thanks in Advance.
Dee

If you insist in using sqldev and keeping it easy, A and C can be done with Tools - Database Export.
You can do the same for D, and delete rows from the script before running it.
And you can do the same for B, then manipulate the data afterwards (with UPDATE).
Also consider using database links and INSERT INTO xxx SELECT * FROM xxx@link, or the external IMPDP/EXPDP tools.
For any questions other than the Database Export, post them under the correct forums (SQL And PL/SQL, Export/Import)
Have fun,
K.

Similar Messages

Is it possible to apply hot backup to do data refresh for another env?

There are 2 environments (UAT & DEV), now I am running HOT BACKUP on UAT environment. Is it possible I use the hot bacukp data file and apply into DEV environment. So that I can do the data refresh in DEV?
Please advice,
Amy

you have two option either go with Duplicate Database or go with Restore And Recover Database to Another Host.
Khurram

Excel Services 2013 Bug - Automatic or Periodic Data Refreshes Doesnt Update

All,
I have heard from other colleagues that there is a problem with SP2013 Excel Services Automatic Refresh. Specifically, when you set the data connection properties to
Refresh data when opening a file, no error is generated upon open, but it DOES NOT refresh the spreadsheet with new data.
Manual Refresh First. What I did to test this was configure an AS tabular model with AdventureWorksDW as the data source. Loaded the AdventureWorks Tabular project. Created an ODC pointing to the resulting cube instance.
(Made all of the required Excel Services configurations.) Then pointed a workbook to this data source to populate a Pivot Table. Saved it to SharePoint in a trusted location. ODC saved to SharePoint in a trusted data connection library. Finally,
I configured the connection properties to NOT Refresh data when opening the file. Saved it. Go to my in browser Excel Services file, and click
Data | Refresh All Connections. WORKS! Great.
Next up: Automatic Data Refresh. I made a copy of the same workbook. Connected to the same data connection file. Went into the properties of the connection on the copied workbook and checked
Refresh data when opening the file. Saved. Updated relational data in database. Reprocessed the tabular model. Re-opened the Automatic refresh workbook. Numbers stay the same.
I've tried also setting Refresh every setting on
Usage tab of Connection Properties dialog to low number. No change. Tried reducing the Excel Services External Data Cache Lifetime auto refresh setting to 10 seconds. Nothing, no change. Nothing seems to work to get Auto refresh
working. Manual refresh works great. Has anyone else seen this bug? Is there a hot fix? Anyone know if there is something else to try?
UPDATE: In the ULS log, what we see if the following line:
BaseWorkbook.PrepareConnectionsAsync: Refresh skipped. Could not find the data connection name - defaulting to previous state. sessionId=..., dataconnection=
Note: the dataconnection value at the end is empty.

Hi,
Thank you for your question. I am trying to involve someone familiar with this topic to further look at this issue. There might be some time delay. Appreciate your patience. Thank you for your understanding and support.
Thanks,
Linda Li
Linda Li
TechNet Community Support

Data Refresh Error: We cannot locate a server to load the workbook Data Model.

Hello,
Recently I have developed a PowerBI Report using Excel Workbook with external data source. It refreshes successfully for some days and then starts throwing error on every scheduled refresh as "We cannot locate a server to load the workbook Data
Model."
The workaround solution is to restart the application server which has SQL Server Power Pivot Services Installed which will again work for some more days and again start throwing error.
So, I am looking for permanent fix for it.
Following are additional details about our SP Farm:
No. of front end servers: 2, Application servers:2, DB servers 2 with windows fail over cluster.
PowerPivot Server is installed and configured from App 2 server.
Error Log from event viewer:
Unable to load custom data source provider type: Microsoft.PerformancePoint.Scorecards.DataSourceProviders.AdomdDataSourceProvider, Microsoft.PerformancePoint.Scorecards.DataSourceProviders.Standard, Version=15.0.0.0, Culture=neutral, PublicKeyToken=71e9bce111e9429c
System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.AnalysisServices.AdomdClient, Version=10.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The system cannot find the file specified.
File name: 'Microsoft.AnalysisServices.AdomdClient, Version=10.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91'
at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type)
at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
at System.Type.GetType(String typeName, Boolean throwOnError)
at Microsoft.PerformancePoint.Scorecards.Server.PmServer.InitializeCustomDataSourceProviders()
PerformancePoint Services error code 10107.
Thanks,
Ibrahim

Hi ibrahim,
Please try to do the following steps:
1. Install "1033\x64\SQLSERVER2008_ASADOMD10.msi" from
http://www.microsoft.com/en-us/download/details.aspx?id=26728
2. In the Application Management section of the Central Administration home page, click Manage service applications.
On the Manage Service Applications page, click the Excel Services service application that you want to configure.
On the Manage Excel Services page, click Data Model.Click Add Server.
In the Server Name box, type the name of the Analysis Services instance that you want to add.
3. Check the thread below:
https://social.technet.microsoft.com/Forums/en-US/ecc18319-88d8-4dd0-bafd-fa0d2edceffb/external-data-refresh-failed-we-cannot-locate-a-server-to-load-the-workbook-data-model?forum=sharepointadmin
More information:
https://timpanariuovidiu.wordpress.com/2013/02/14/71/
https://support.microsoft.com/kb/2769345?wa=wsignin1.0
Thanks,
Dennis Guo
TechNet Community Support
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact
[email protected]
Dennis Guo
TechNet Community Support

PowerPivot Data Refresh Fails - We cannot locate a server to load the workbook Data Model

Hello,
I have installed sql01\PowerPivot instance of Analysis services on my existing SQL Server and configured it per Configure Power Pivot for SharePoint 2013
http://technet.microsoft.com/en-us/library/dn456880(v=office.15).aspx . I did not install a second Database Engine on the server.
I created an Excel 2013 workbook using the Excel 2013 PowerPivot add-in and saved it to my SharePoint BI Center Document library.
When I try to refresh my workbook, I get 2 errors in the SharePoint log.
http://support.microsoft.com/kb/2756665?wa=wsignin1.0 indicates the sproc is deprecated, but that does not help me fix the issue.
Log errors:
Following error occured while trying to execute a sql query: System.Data.SqlClient.SqlException (0x80131904):
Could not find stored procedure 'DataRefresh.GetSchedule'.
EXCEPTION: NoAvailableStreamingServerException: We cannot locate a server to load the workbook Data Model.
macrel

Hi Marcel,
Based on my research, it seems that you have Microsoft SQL Server 2012 PowerPivot for SharePoint 2013 add-in installed on a computer. When you perform a data refresh operation on some PowerPivot workbooks in Microsoft SharePoint 2013, you receive two error
message.
As to the first error, this issue occurs because the Custom Properties on the Excel workbook are not correctly cleared before you set a new serialized schedule. This causes an extra custom property to remain after you set the new schedule. Therefore, the
new schedule fails. To fix this issue, please
install Cumulative Update 9 for SQL Server 2012 SP1.
As to the second error, please
running a repair using PowerPivot configuration wizard for SharePoint 2013. For more information about Troubleshooting PowerPivot Data Refresh, please see:
http://social.technet.microsoft.com/wiki/contents/articles/troubleshooting-powerpivot-data-refresh.aspx
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

External Data Refresh Failed. We cannot locate a server to load the workbook Data Model. ThisWorkBookDataModel

Hi All,
I have been trying to fix this for days now. I have tried solutions in many articles but to no avail. So while the error message is something you may have seen may times, I just can't find a solution in my case.
This is the error:
And in text just in case the image isn't viewable:
"External Data Refresh Failed. We cannot locate a server to load the workbook Data Model. We were unable to refresh one or more data connections in this workbook. The following connections failed to refresh: ThisWorkBookDataModel."
What is worse is I have checked the ULS (SharePoint Trace Logs), the Event Viewer Logs and the OWA Logs and I cannot find a specific error that would help pin point the problem.
Excel Workbook
So what am I doing? I have an Excel 2013 workbook and I create an "SQL Server" connection to the AdventureWorksDW database, add a pivot table and a pivot chart, test in in Excel and all works fine.
I save the Excel workbook to SharePoint 2013 and then select "Data" then "Refresh All Connections" and then I get the error in the picture above.
Even more puzzling is I have another Excel workbook that also has pivot tables and pivot charts in the AdventureWorksDW2012Multidimensional cube database in "SQL Analysis Services" and this works fine. Hmmm.
My Environment
My environment is Windows 2008 R2 Server, SharePoint 2013 with the April Service Pack1 and a separate server with OWA2013 SP1. It has an SQL Server 2008 R2 database which has been upgraded to SQL Server 2012.
Data Model Settings
In Excel Services this is set to my server name which is "server-name". As I do not have instances all I can enter is the server name. As this works everywhere else including the workbook outside of SharePoint I do not think this is the problem.
But I could be wrong.
Unattended Account
I have set this up for the PowerPivot Services App and Excel Services App.
ODC Connections in Excel
I have tried all 3 authentication modes, Windows, Secure Store ID and "None" which is the unattended account. I have not tried the other connection types, should I?
Not in WOPI
I am not in WOPI mode.
AD Accounts
I have added permissions in the SharePoint Services and SQL Server, and as they work in Excel outside of SharePoint, I do not think it is a permissions issue. I could be wrong of course, but the problem is in one of SharePoint, OWA, AD,
SQL Server, Excel, and Windows Server.
Isolate the Error
Below is a list of errors I think are relevant but they do not tell me much. The SharePoint logs are not really giving me an error that tells me what to do and where to do it, or even why it cannot refresh, (perhaps not noticeable by the untrained eye).
Problem with SQL Server Not Analysis Services
So my cube database in analysis services works fine in SharePoint/OWA but not the databases in sql server. This is my best clue but I have no idea what it means. Why would it work with an Analysis Services connection but not an "SQL Server" connection?
It Works Outside of SharePoint
If I run the excel worksheet outside of SharePoint all works fine. When inside OWA this is where the refresh error occurs.
Errors from Event Viewer on SharePoint Server using ULS Viewer
"Failed to create an external connection or execute a query. Provider message: There are no servers available or actively being initialized., ConnectionName: , Workbook:"
"Refresh failed for 'ThisWorkbookDataModel' in the workbook 'http://server...'. [Session: 1.V22.26itT0lx8piNFeqtuGVhN214.5.en-US5.en-US36.98c0e158-9113-46e9-850e-edda81d9ed1c1.A1.N User: 0#.w|ad\testuser1]"
And an error in the ULS under the "Data Model" category:
"--> Check Deployment Mode (server-name): Fail (Expected: SharePoint, Actual: Multidimensional)."
This last error, as it turned out, defined the problem concisely, although I was yet to work out what it meant in some detail.

I finally solved this myself (or should I say with the help of several key articles).
The refresh did not work because the database was not in "SharePoint Mode". Yes, SQL Server has modes, 3 of them in fact.
If you installed SharePoint to the default SQL instance which would be called <servername> then you cannot use this default instance for Excel 2013 workbooks in OWA 2013 because the refresh only works if the database is in SharePoint mode.
So what are these 3 modes? The Deployment Mode property in the msmdsrv.ini file has them as:
0 = Multidimensional mode (the default whenever you install SQL Server normally)
1 = PowerPivot for SharePoint mode
2 = Tabular mode mode
How do you know what mode you are in? That's easy, open SQL Studio Manager and connect to all your SQL database engine instances (ignore Analysis Services or SSRS as they are not database engines). If you only have the default instance then that is almost
definately in Multidimensional mode which is the default and what SharePoint installs its databases to.
You must have an instance called <servername>\POWERPIVOT. This instance is the "sharepoint mode" needed, and the default instance name when you install an SQL instance in this mode.
If you don't see <servername>\POWERPIVOT in SQL server then you are not in "sharepoint mode". It is more accurate to say, you do not have an instance that is in sharepoint mode. This is because you cannot simply switch modes on an SQL server.
You have to install a new instance in the required mode, thats the only way.
That's easy enough. Load up the SQL Server setup CD and run setup. Install a brand new instance and select "SQL Server PowerPivot for SharePoint" when you get there in the wizard.
Now you will have the default instance that stores all the SharePoint databases and that is in mode 0, and a new instance called <servername>\POWERPIVOT that is in mode 1. The "<servername>\POWERPIVOT" instance connection is what you
will use for Excel 2013 when rendering in OWA 2013.
You also need to ensure OWA 2013 is not in WOPI mode for Excel worksheets. See the last link below for more information about WOPI.
Next you should go to the Excel Service App in CA and click Data Model Settings and add the <servername>\POWERPIVOT instance.
Then you have to either turn off the firewall on the SQL server machine, or create an inbound rule on the Windows firewall to open the TCP port for the <servername>\POWERPIVOT instance:
1. Start Task Manager and then click Services to get the PID of the MSOLAP$InstanceName.
2. Run netstat –ao –p TCP from the command line to view the TCP port information for that PID.
Finally, you can now create Excel 2013 workbooks that run in OWA without refresh errors, as long as you are connecting to the <servername>\POWERPIVOT instance. Hooray.
REFERENCES
Look for the string "There are no servers available or actively being initialized" in this article:
http://blogs.msdn.com/b/analysisservices/archive/2012/08/02/verifying-the-excel-services-configuration-for-powerpivot-in-sharepoint-2013.aspx
Determine the server mode:
http://msdn.microsoft.com/en-au/library/gg471594(v=sql.110).aspx
Install the SharePoint PowerPivot instance (aka SharePoint mode)
http://msdn.microsoft.com/en-au/library/eec38696-5e26-46fa-bc83-aa776f470ce8(v=sql.110)
Open the port for the new SQL instance:
http://msdn.microsoft.com/en-us/library/ms174937(v=sql.110).aspx
Turn Off WOPI for Excel OWA
http://blogs.technet.com/b/excel_services__powerpivot_for_sharepoint_support_blog/archive/2013/01/31/powerpivot-for-sharepoint-browser-refresh-fails-data-refresh-not-supported-in-office-web-apps.aspx

"External Data Refresh Failed" in Excel Workbook in SharePoint 2013

Hi Everyone,
I hope someone can help me sort this out. I wasn't sure if this should be submitted to SQL Server 2012 or SharePoint 2013 but I think I have ruled out an actual SQL issue here.
I have a test SharePoint 2013 Farm installed on one server. On that server we have SQL Server 2012 Standard (Database Engine Only) installed as one instance for SharePoint 2013. SharePoint 2013 is installed as Enterprise.
On another server I have SQL Server 2012 Enterprise installed I have both the Database Engine and Analysis Services installed on that server in one Instance.
I have created a new Analysis Services Cube and stored in on that server using VS 2012 Data Tools.   I then use Office 2013 Excel and create a new Pivot Table and bring in that data into that workbook. I save that workbook to my desktop and
can click on the DATA tab and do a "Refresh All" and the data is refreshed with no problem.
I then Save that Workbook to SharePoint 2013 in my Business Center documents library. I then try to do a Data Refresh and get the following error: External Data Refresh Failed. We were unable to refresh one or more data connections in the workbook. The following
connections failed to refresh: servername ConnectionName.
Let me tell you a little bit about how I have my SharePoint 2013 setup.
In Application Management ==> Secure Store Service - I have a Target Application Id setup with an AD account name and password.
In Application Management ==> Excel Services Application Settings - I an using an Unattended Service Account that is pointing to the Target Application ID that I setup in Secure Store Service.
Now in SQL Server 2012. I have made the AD account name and password a SYSADMIN account (because nothing seemed to work) and mapped that login to my Database that I created my cube from.
I have went into the Properties of my Analysis Server on SQL Server 2012 and out that AD userid in the Security Page as a Server Administrator.
Now let me tell you the real kicker here.
I also have a Sharepoint 2010 farm that we have been testing for about a year. This is something we wanted to go into production with but now have decided we will deploy our new production site on 2013.
This has the same setup only I am using SQL Server 2008 R2 as my database for SharePoint 2010, and am using SQL Server 2008 R2 on another server and instance for Database Engines and Analysis Server.
I have already created a cube on the SQL 2008 r2 Analysis Server using BIDS.
I created a Excel Pivot Table based on that cube and save it to the SharePoint 2013 site.
I then put the SSS AD account name on the SQL Server 2008 Analysis Services Security as Administrator.
I pull up that Excel Workbook and go into Data and do a Refresh All and it works.
I then bring up my copy of the Excel workbook I created for my SQL Server 2012 Cube (this does not work on SP 2013) and save it to my Business Center in SP 2010. This will do a DATA Refresh on that workbook.
Another thing that I have done, (we have Office Web Apps Server running on the SP 2013 side), is set SPWOPISuppressSetting -view -extension xlsx so that when I bring up the Excel spreadsheet in 2013 it has a url with the xlviewer instead of the WOPI
url.
OK. I have went through all of my setup.   I am must wondering if I missed something in my install for this. HELP.   There can't be that much difference in the installation between 2010 and 2013.
Thanks in Advance everyone.

After many hours of research and totally burning down my SQL Server 2012 server because of the many changes I made to it, I finally found the issue that caused this and specifically why SP would not work with SQL Server 2012 Analysis Services. This
time I reinstalled SQL Server 2012 from scratch again but only put SP1 on at this time. I can't be completely sure this fixed the issue since I have not put any of the other CU on the box. But, after the reinstall, everything seemed to work
perfectly from the Excel Services side.
The issue I then ran into was that I could not get my PerformancePoint Services to work with my Cubes that were created on SQL Server 2012. I received Error Message " The DataSource Provider for data sources of type 'ADOMD.NET' is not registered" on
my SharePoint 2013 Server Event Viewer.
I finally found this post on the issue:
http://yossidahan.wordpress.com/2012/08/14/cant-get-ssas-databases-to-appear-in-performance-point-dashboard-designer-check-you-adomd-net-version/
Seems that SP 2013 is built to use SQL Server 2008 R2 Analysis Services, so you need to install the ADOMD.net from SQL Server 2008 in order for it to work.   But make sure you install Version 10 since if you install any other it doesn't seem to
work.
I feel like I wasted a whole month tracking these issues down, and I haven't been able to test PowerView, PowerPivot or SSRS yet. I hope there is not any more.

How does your entity, or entities you have worked with, manage data for their dev/quality/cert environments?

Background- We have development and certificiation environments for SAP changes. These environments are kept in sync by ensuring that we adhere to a progression for configuration changes- they always move thru the same dev, quality, ceritfication, production process with testing at each phase.
As a business user, a challenge I encounter is having production type data available in the dev/qual/cert environments so that I can adequately test changes. We refresh our environments periodically to a copy of production, including data. After the refresh, no new data goes to these environments, only test data as entered by individual users and testers. This means that tests performed soon after a refresh have a lot of relevent production data to use for testing, but as we move further thru the year, the data is less and less avialable and less relevant.
Some of our changes are impacted by volume, but due to how we handle our environments, volume impacts are difficult to test or asess.
How do you manage production-like data for your dev/qual/cert environments? Do you encounter this same issue or have you found a solution?
Thank you!

Thanks for your comments, it is clear you understand my plight. The trouble is fully understanding what Apps and App Features are transferring data in the background any time you happen to turn WiFi to on (even if you have had it off most of the day or night). Obviously things like Location Services can constantly be sending and receiving data from my iPhone without any action on my part. Also if you have things like photo backup on the iCloud then each time you take a photo you are sending a copy out. All App Updates if set to Automatic also can add up to quite a bit of Data. Reading the News on AP or scrolling through FB News Feed is actually adding up to a lot of Data. There could be other culprits that I am not even thinking of. I don't want to turn Apps like Find My Phone off or turn iCloud off due to loosing the value of such a program entirely. Again thanks for your quick response.

SAP HANA data refresh

Hi,
Need info regarding data refresh in SAP HANA, do we need SAP TDMS to refresh data in HANA box?
NW to HANA , HANA to HANA , HANA to NW
I went through few articles but its not clear, hope i get more info here.
regards
Vinay

Hi,
Please describe your exact requirement in detail? You want to move data between DEV, QA and PRD or do you want to take it from another DB into HANA?
Regards,
Michael

Refresh of DEV from PRD

Hi, SAP Gurus!
For our upgrade project, we need to refresh the DEV system from a recent copy of PRD. Our dev system must contain only configuration (i.e. no user data). This needs to be a new system with only ONE client in it. PRD and QAS are also single client systems.
We have not been able to find any official SAP document on this procedure.Seems like a standard procedure, so there should be a documented guide out there.
We are under a WIndows 2003 + Oracle 9i setup and running R3 Enterprise 4.7 ext. 2.00.
DEV is the domain controller for STMS.
Any ideas you can provide are wellcomed.
MC

Hi,
For your scenario it seems you need to go with client copy , but
This needs to be a new system with only ONE client in it
But this doesnot means it is new system either you can create new client in DEV or can overwrite any existing client.
For copying only configuration refer this link
https://cw.sdn.sap.com/cw/docs/DOC-33675
Other option is system copy but that will replicate your PRD data including master and transaction(I guess that is not required).
So you need to explore client copy option for your requirement.
Regards,

How scheduling the data refresh for a published Excel workbook - SharePoint 2013

Hi,
I've implemented an Excel workbook that connects to a SSAS Tabular data source and I've published it on SharePoint.
Now, how can I implement a scheduled data refresh if it is possible?
Thanks

Hi pscorca,
If my understanding is correct , you want to implement a scheduled data refresh on SharePoint 2013 and the data is from a SSAS Tabular data source.
Below are some articles for you to take a look:
Data Sources Supported (SSAS Tabular)
http://technet.microsoft.com/en-us/library/gg492165.aspx
Get data from Analysis Services
http://office.microsoft.com/en-in/excel-help/get-data-from-analysis-services-HA102837073.aspx
PowerPivot Data Refresh with SharePoint 2013 and SQL Server 2012 SP1 (Analysis Services)
http://technet.microsoft.com/en-us/library/jj879294.aspx
Refreshing PowerPivot Data in SharePoint 2013
http://blogs.msdn.com/b/analysisservices/archive/2012/12/21/refreshing-powerpivot-data-in-sharepoint-2013.aspx
I hope this helps.
Thanks,
Wendy
Wendy Li
TechNet Community Support

Data refresh of Excel file on Sharepoint 2013 Online (E3)

Is it possible to refresh data in an Excel PowerPivot model from external data (SQL Server 2012) on the
SharePoint 2013 Online solution that comes with the Office365 E3 plan?
I need to either have the Excel file itself on the public facing website with data refresh there, or possibly have the Excel file in a private Business Intelligence Center subsite and then publish webparts or whatever on the public site, as long as the charts
are refreshed and publicly viewable. I've found a lot of conflicting info on this.
Re
D

Currently, when a workbook that contains a Data Model is published to a library in Office 365, data refresh is unavailable.
However, you can use a PowerShell script to configure a workaround.
donwload this white paper for workaround:
http://technet.microsoft.com/en-us/library/jj992650.aspx
Please remember to mark your question as answered &Vote helpful,if this solves/helps your problem. ****************************************************************************************** Thanks -WS MCITP(SharePoint 2010, 2013) Blog: http://wscheema.com/blog

Data refresh in background for an Excel workbook published on a SharePoint 2013 site

Hi,
I've created a site to publish some Excel workbooks on a SharePoint 2013 farm with Excel Services.
I'd like to run in background the data refresh against the cube connected to Excel, so when the end user will open the workbook he already will see the updated data without any waiting times.
How can I solve this issue, please?
Keep attention: I don't talk about PowerPivot for SharePoint.
Thanks

did you try to use the
unattended service account for authentication to external data, in order to refresh the excel data?
Check this technet: http://technet.microsoft.com/en-us/library/hh525344.aspx
more options over here:
http://technet.microsoft.com/en-us/library/ff191191.aspx
Please remember to mark your question as answered &Vote helpful,if this solves/helps your problem. ****************************************************************************************** Thanks -WS MCITP(SharePoint 2010, 2013) Blog: http://wscheema.com/blog

Power Query/Data Management Gateway data refresh not working

Pretty new to o365/Power BI, but here's what I've got going on (hopefully someone can help me out):
I created a data management gateway and data source. The data source says it's online in the PowerBI admin center, and it seems to be working correctly. I can open Excel 2013 on my desktop (logging in as my trial o365 account which has Power
BI associated with it) and connect to the data source via Power Query using the oData option. I make sure to import the data into the model, and then open up the PowerPivot window and create a simple pivot table using the data in the model.
that all works just great. The problem comes when I upload the workbook and try to update it. I've tried a few different ways.
1. When I try to manually refresh the workbook by opening it in my o365 site and going to data-->refresh I get the following error:
      An error occurred while working on the Data Model in the workbook. Please try again.
      We were unable to refresh one or more data connections in this workbook.
      The following connections failed to refresh:
      Connection: Power Query - dbo_DimProductCategory
      Error: Out of line object 'DataSource', referring to ID(s) 'a75593f3-c34d-4f83-9458-49aa2cece164', has been specified but has not been used.
      The following system error occurred: Class not registered
      The provider 'Microsoft.Mashup.OleDb.1' is not registered.
      Power Query - dbo_DimProductCategory
2. When I go into Power BI and go to "Schedule Data Refresh" for the workbook, I get the following error:
      Sorry, the data connections in this report arenâ€™t supported for Scheduled Refresh.
      Technical Details â–¼
      Correlation ID: B3CE4B10-2137-E593-6FCF-189B73465190
      Date and Time: 03/31/2014 06:20:39 PM (UTC)
Any help would be greatly appreciated. If you need additional information, I'd be happy to provide it.

Hey Guy,
Thanks for the reply.
The "data source type" of the data source in Power BI is "SQL Server" (there was only that and Oracle available to select from)
The "data source type" that Power Query is using in Excel is "From oData Feed"....which is using the Power BI data source....which is using the data management gateway.
A few follow up questions if you have a second
1. Do you know when PowerQuery data refresh will be supported? (just a general idea....weeks, months, next year?)
2. Is there any other way to connect to (and be able to refresh) PowerBI data sources referencing "on prem" data via the data management gateway? I tried using the oData feed URL in non-PowerQuery areas of excel (excel data tab, PowerPivot directly)
but it didn't work. If there's some other way to connect to and refresh on prem data, i'm all ears :D
Really appreciate your help, thanks for taking the time.

Scheduled Data Refresh fails with 400 error

I've setup a PowerPivot Model, connected 1.5 Million rows (57MB file) rendered the data in a powerpivot table and uploaded it to an PowerBI enabled BI site in O365.
Report renders online
Q&A works too
Configured data management gateway
Connected DMG to PowerBI
Configure data source with the same Connection String
Set credentials for data source with Status OK (only can do this step from a domain joined computer which I find odd)
Enabled Data Refresh on the Report with status OK (i.e. it found the corresponding data connection on the gateway)
Tried to manually refresh the data.... no luck. keeps on failing with the following error message
Failure Correlation ID: c1dcf840-e0c8-45d6-9720-b4d2c9695b5a
Errors in the high-level relational engine. The following exception occurred while the managed IDataReader interface was being used: The operation was canceled.;transfer service job status is invalid Response status code does not indicate success:
400 (Bad Request).. The current operation was cancelled because another operation in the transaction failed.
Everything seems properly configured. lots of green ticks whenever I set things up. But manual refresh keeps on failing.

I've reduced the query down to 100,000 records and now I'm getting
Sorry, something went wrong. Please try again. Correlation ID: 7e498494-95d0-4dff-84ed-ead169a5617e
The DMG is not even registering the attempt in the event logs.
Before at least I managed to get this:
Microsoft.DataTransfer.Common.Shared.HybridDeliveryException: The Data Transfer Service has encountered a fatal error when performing the data upload. ---> Microsoft.WindowsAzure.Storage.StorageException: The client could not finish the operation within
specified timeout. ---> System.TimeoutException: The client could not finish the operation within specified timeout.
   --- End of inner exception stack trace ---
   at Microsoft.WindowsAzure.Storage.Core.Util.StorageAsyncResult`1.End()
   at Microsoft.DataTransfer.ClientLibrary.BlobUploadTask.PutBlockCallback(IAsyncResult asyncResult)
   --- End of inner exception stack trace ---
   at Microsoft.DataTransfer.ClientLibrary.BlobBinarySink.Write(IEnumerable`1 streams)
   at Microsoft.DataTransfer.ClientLibrary.BinaryTransfer.Run()
   at Microsoft.DataTransfer.TransferTask.TransferRuntimeTask.Execute()
   at Microsoft.DataTransfer.TaskHosting.ThreadTaskWorker.RunTask()
Job ID: edd0fec1-789a-4487-a371-6aafbd8aaffa
Task ID: b71f8b48-b4ff-43f5-8dc5-6aefd390c0fe
Queue ID: a41a0d92-8327-458a-80e0-2cf3065dd705
Log ID: TaskExecutionFailed
So far my analysis is:
1.5M rows = won't even start pushing data and will timeout very early in the process
300,000 rows = will get past the initial timeout (probably the query identifying how much data needs to move), just to crash on the second timeout (actually pushing the data to the cloud).

Data refresh on dev instance

Similar Messages

Maybe you are looking for