Best practise to move data to new datawarehouse partitions

Our DW is about 500GB and expected to double in the next three years.
Largest table has 290m rows, but some fact tables have as little as 1k rows.
We are also migrating to SQL Server 2012 (2008R2) by building new servers and will split SSRS and DBMS.
I was thinking I would only partition the larger fact tables, but my dilemma is moving the data to the new servers.
Trying to avoid having to load each table manually, so would moving the tables to be partitioned to a different database on the current server be a viable option, what about all the current subscriptions and SSRS reports ?
Then at some point (only 5 years data) we will need to start archiving, so I wanted this physical design to fit in with assisting the archiving process, seems crazy to partition every fact table or is that a better strategy ?

Hi,
I will move this thread to SQL Server Data Warehousing forum for further discussion.
Here is a link to article on partitioning on Microsoft SQL Server:
Strategies for Partitioning Relational Data Warehouses in Microsoft SQL Server
http://technet.microsoft.com/en-us/library/cc966457.aspx
Thanks.
Tracy Cai
TechNet Community Support

Similar Messages

Best way to move data and programs to another profile on same Mac?

Hello,
What is the best way to move data and programs to another profile on the same Mac? I have a user who's profile is corrupt, I know that most programs will work on both the new and old profile however when trying to copy the Desktop folder, or Documents folder I am getting permissions denied.
Sort of like weeding a garden, I'm hoping I do not have to pick the data in each folder and copy individually.
Thanks for your help!
Johnathon

This usually means that a configuration or preference file is corrupted. In this user's /Home/Library/Preferences/ folder locate any preference files associated with iLinc and drag to the Trash.
I would also check in the /Home/Library/Caches/ folder for a file or folder associated with iLinc and delete as well.
See if the problem is resolved in the user's normal account.
It's not that you cannot copy data from account to account, but doing so causes a lot of permissions issues that must be resolved. The MacFixit article I linked above shows what you need to do after transferring from one account to another in order to change permissions on the "foreign" files to those of the destination account.

Best LKM to move data from with in Oracle from one schema to another Schema

Hi Gurus,
What is the best KM to move data from one schema to another schema within same oracle database.
Thanks in advance

Dear,
If your source and target are on the same database server then you dont need LKM.
You have to 1. create one data server for the database server
2. Create one physical schema for your source and another physical schema for your target under the above created data server.
3. Then create models for each above created physical schema
In this case you just need IKM knowledge module
Please refer http://oditrainings.blogspot.in/2012/08/odi-interface-source-target-on-same.html
If your source and target are on different server then you must create two different data servers in topology. You have to use LKM.
The best LKM to use is LKM oracle to Oracle dblink. But you should have proper grants to use it
If your source has very few records you can go with LKM SQL to Oracle other wise use LKM oracle to Oracle dblink

Best way to move data from page to page inside app

Hi all I started writing this and it got way to complicated to explain in full without a novel.
Breif description. I am using query string that starts in the parent window (from href in json file) it then has to be moved into the iframe url when moving to other pages to avoid security as page and iframe are conflicting http and https. and cannot be accessed.. it seems there must be a better way.
So my question is what is the best way in open platform to move data from one page to another?

Hi Liam
Small data just a webapp ID and I am using the URL. But if you pass a ID say from Json ie "href":"/Admin/AppLoader.aspx?client_id=dev-name&ID=111111" it gets passed to the page url. This can be referenced using document.referrer initially. As the app is inside another frame and url that is https there is security issue using parent.location between https and http. Fine but then if you move to a new page referrer is no longer as there is no real referrer and you have to use location but you cannot. Now the work around is to pass the value from the page url to the app url at the start. and then you get around http https security issue when using parent.location but this seems convoluted and like a work around. Is this really the only way or the best way or a bad way. without using other ways that seem over kill for 6 odd characters.

Best way to move data from table to a file

Hi,
I have a two tables in ecc, And I need to read the data and copy to a file and ftp to another server.
One table is really huge. What is the best approch to move this data using PI. I can not avoid PI, since it needs some mapping.
1. Proxy-PI-FTP
2. Dump the data to a file and use FTP_PI_FTP
3. Any other.
Thank you
Moni

it is really a project decision but I can give you some pro's and con's.
Proxy --> File
You cab communicate directly with the XI pipeline which means you don't have to go through the adapter engine.
RFC --> File
This is very standard SAP and most ABAP programmers will be able to utilize this.
IDoc --> File
Standard SAP ALE technology but can get very big due to useless segments
Dump File
The biggest positive of this is the fact that you wouldn't have to convert to XML which will ensure that the message doesn't grow in size as is the case with all of the above.
This is very brief but should give you a good idea....

Best way to move mail to new MacBook Pro

I have my new notebook and the only items I want to move across is my mail. What's the best way to move my old mail to the new notebook.
Migration Assistant
Drag and drop

What mail client are you using? In Entourage you'd want to export your mail store to an .rje file on your old machine, move that file to your new one, then perform an import.

What is the best way to move data from one array to another

I'm going to be moving data from one array to a larger array on the same RAID but different controller. (I have some extra extra drives I'm also going to be installing Retrospect so I can't just restore from a backup.)
The RAID has 450GB of production files, fonts etc.
What is the best way to move the data over?
I saw that someone had suggested using ditto. Would that be better than MacMV?
I also own Bru LE so I could use that.
Any advice would be appreciated.
Thanks,
Paul

Ditto is a great option -- probably the best.
ditto -rsrc src_folder /Volumes/targetvolume/targetfolder

Best practises Subversion and Data modeler

hello, i'am looking for some best practises regarding subversion and datamodeler.
A team of 10 analysts create several releases of our product over time.
Within one release you'll find several change requests.
The application itself contains about 700tables so performance is important.
I want to establish a lean working method were analyst can focus on their job - design.
Till now I think to create one trunk containing the db model let's call it v17.00
An analyst could create their designs in separate projects grouped by change request eg CR1234.
When development starts i would compare the trunk model with their change request to generated the alter script.
Afterwards i would import their design CR1234 into the trunk.
Note : it's possible that a change request got cancelled - that's why i opt for a design per change request.
This way of working seems much leaner than the setup of branches and merging.
My opinion, being a novice subversion user, is that setting up branches and merging is "more complex" and might causes frustration for designers.
Anyone having a simular setup or advice ?
kr
chris

Hi Sam,
Let me add my two cents here, when speaking about MAN deployments the name of the game is MPLS, so I guess you are using the same on your Cat 6500s and connecting your customers on 3550s using Vlans.
Regarding your questions:
a) Upgrading Ethernet to L3 for traffic shaping: This is basically done at 3550, so I suppose that's what you intend to do, plus you will be letting Spokes talk to only Hub site, so inter Vlan, atleast between Hub and each spoke will be required, hence inter valn routing. Other way is to configure P2P circuits between Hub site with Vlan mapping (per spoke) and Spoke sites with Port mapping, in this scenario Inter Vlan routing is not a necessity.
b) Security: This depends on what exact architecure you have deployed, in my case I have simply installed a Gateway router with BGP peering with PEs, a separate VRF alongwith redistribution does the trick.
Hope I addresses the query correctly, let me know if that helped..
Cheers
~sultan

What is the best way to move data from an old G3 to a new iMac?

The G3 does not recognize a USB flash drive. Will an external hard drive work if we have software to install drivers?

Use an ethernet cable to connect the two computers, and set up file sharing. After that copying files from one computer to the other is exactly like copying from one hard drive to another:
http://docs.info.apple.com/article.html?artnum=106658

Best way to move WFE to new server

We have one web front end server and one sql server. I want to simply move the existing web frotn end server to new hardware. What is the easiest way to do this? Also, the last admin did not patch the existing site to SP2. If I
install Sharepoint 2007 sp2 and attach it to databases that are on the original Sharepoint 2007 RTM version, will it upgrade the database schema or will this cause problems? We only have on site colelction with about 13 GB of data, its not a complicated
environment but there is a lot of data there. I want to do this as simply as possible, thanks.

The basic three steps that need to followed while moving to new hardware are.
Set up the new server farm
Make sure the versions of database are the same in this step.
Move the databases to the new server farm
Since you don't have many webapplications, in fact just one, you could do an stsadm backup of the web application and restore it on the new web app. And then Apply SP2 along with all the other cumulative updates.
You will have two farms running at the same time at this point providing redundancy.
Shut down the old server farm
That is probably the best approach I would prefer. You can always read the following technet article..
http://technet.microsoft.com/en-us/library/cc512725(office.12).aspx
Hope this helps.
Thanks
V
V

Best way to move data

I purchased a new 17" imac for my wife. I need to move her data which consists of old emails through outlook, word files, print shop files etc. Not too much more. But in order for her to feel comfortable with the switch to mac she needs to hvae everything there.
I looked at the move2mac software and people do not seem happy with it.
What is the best way to do this. Any tips would be great.
by the way, I did not thing the support tips on the mac site were that great.

I've actually heard only good things about Move2Mac. Regardless, instructions for moving data over are here:
http://www.apple.com/macosx/switch/

Best Practise to handle Data Refresh & Hierarchy

Hi,
During a recent discussion with one of our BI user groups, the questions were raised as what the best practice are to handle the following two issues.
Issue 1:
If entries are posted to the prior periods in SAP R/3 (outside of the daily auto-refresh range), the current process is that the user group will ask us to conduct a manual refresh in BI for the prior periods which are effected.
Question: Is it possible to set up a trigger in the system, so that BI knows which periods are changed and automatically refreshes data for those periods?
Issue 2:
If a hierarchy used in the reports is modified, there might be an adverse impact on the financial data the user group reports. The current process we have in place is to run a group of BI reports for both current year and prior year to make sure nothing is impacted, but there is limitation to this current process. What if there is no impact on current or prior year, but on the years prior to that?
Question: What other global companies do to minimize such reporting impact, especially when they have hundreds of complex reports?
If someone has any info on this, help me in sharing the same.
Thanks all for your support.
Regards,
Murali

Hi,
1) I would recommend you consider doing another delta init w/o data transfer for all years. (of course first you need have a quiet time in the source system, then need to pull the existing data in the delta queue).
If you don't and /or can't have delta loads for some reason, in the source system, find the table(s) for the old periods, check with your DBAs to see if they can create a "database trigger". With that, when this table is changed, they can send the new/changed record to another copy table that you can create an extract against it.
2)When a major report needs a change or when we need to change an infobject/hierarchy that will impact many reports, we ask our business analyists/super users/reporting gropus to test the key reports. This is of course after we run some queries in our QA environment to compare the results (before and after the change).
I would like to get consensus from all the regions before touching the global reports, and have them send me their agreement on it. If everybody is happy, we make the change, ask user to test the query and give us a sign off in QA, then send the query/infoobject.hierarchy to production and regenerate the queries in prodcution if necessary. If you are not too comfortable making this change, at least try avoiding the key dates/weeks, maybe send the change to production Friday afternoon so that if it doesn't work you can change it in the weekend etc.
Cheers
Tansu

2006 MacBook Pro died, best methods to transfer data to new MacBook Pro

So my Rev. A MacBook Pro 2.16Ghz intel core duo finally died, looks like something on the logic board. So I bought a brand new 2011 2.2Ghz MacBook Pro. I have purchase and On The Go 2.5 inch enclosure from OWC, it's a USB device. the old hard drive is now in the enclosure, and I'm awaiting delivery tomorrow, of the new MacBook Pro.
My question is, what would be the best method to transfer old files. I want to start fresh with library and system files, as well as email IMAP files. my main concern is applications.
Can I simply drag the actual app from the old app folder to the new app folder? Will it bring along with it preferences and settings? Or do I need all the .DMG files to install the app into the new MBP?
Apps like; Audiohub, Connect360, Adobe Photoshop, Illustrator, Premiere Pro. honestly there are so many more that I can't remember right now.
Thanks in advance.

You can attempt to manually move these files but if it doesn't work then just migrating the whole user and deleting the items you don't want might be the way to go.
Copy the following files from the old HD to their matching location on the new computer and then restart the computer before you launch any of these applications:
Safari: Users / Your User / Library / Safari
iCal: Users / Your User / Library / Calendars
Addressbook: Users / Your User / Application Support / Addressbook
iChat : Users / Your User / Library / Preferences / com.apple.ichat (there may be more than one of these files. copy them all over)
I don't use Skype so I don't know exactly where they store their files but checking in Users / Your User / Library / Skype would be a logical place to start. You can certainly ask in the Skype forum: http://forum.skype.com/
Adobe products tend to have bits and pieces scattered throughout. There may be a simple solution but I would suggest you inquire in the Adobe forums: http://forums.adobe.com/community/photoshop/photoshop_macintosh
Best of luck!

Best Way To Transfer Data To New Mac

I know this question has been asked ad naseum, but I can't seem to find exactly what I'm looking for today...
My new iMac arrives today (w00t!) and I want to transfer all my data over to the new computer. But I'm coming from a Mac that is four years old (though still running Lion) and there's probably a lot of crap on the old machine like corrupt preferences and whatnot, and I don't really want all that baggage coming over with me. I obviously want to transfer over my documents, iTunes and iPhoto Libraries and all the iWeb stuff and whatnot. I'm not afraid to reinstall my apps, if that's the ideal scenario and I don't care if my settings and dock reverts to deault, if that's the best way to do this. So I'm trying to determine the best (and possibly fastest) way to load up the new Virgin machine. I have the ability to connect the two computers via Firewire and I also have an up-to-date Firewire Time Machine Backup of everything as well. Any and all advice is appreciated. And don't be afraid to tell me I'm crazy and that I shouldn't worry about corrupt stuff and I should just Set Up Assistant or Migration Assistant (though I hear Set Up is better?) Thanks!

If all you want to migrate is the data files then use Pondini's Setup Assistant guide as instructed. It will ask what you want migrated however if you only choose data it will migrate ALL of your data files. If you have some files you don't want to migrate then it may be best to start the old machine in Target mode after setting up the new machine then you can pick and choose what data files you want to copy over to the new machine.

Best way to move files to new computer?

Struggling to move about 10,000 files from my old computer to new computer. PSE10 in both computers running on windows 7 pro. Trying to use an external hard drive, but ending up with some empty folders; and the pop up says the images are already in the catalogue. I see all the files in explorer but can't get all of them visible in all folders?
Would I have done better connecting each computer directly?
Basically I'm asking what is the best method to copy/move files when upgrading to a new computer?

That is what I tried first with my Seagate external hard drive, but it would not allow restore on a different computer. It seems Seagate requires purchase of additional program to allow sharing to a different computer. So I tried using my older Lacied external hard drive with only 80gb which is less than my total catalogue size; so I could not do a simple backup and restore; so I manually dragged and dropped what would fit, ending up with the missing folders I mentioned. I just did a reconnection of files and think I finally have all folders full.
So Seagate was a waist of money. What external hard drives work well for a backup and restore, as you suggest? Or does someone else have some other recommendations?

Best practise to move data to new datawarehouse partitions

Similar Messages

Maybe you are looking for