Tools for dedupe & old data

Hi,
We have an old Windows Server 2003 file cluster and we are planning on migrating our data to a new solution, unsure where the data will live just yet... cloud or on-site, who knows!
We have approx. 3TB of data.
Before we make any decisions we need to know how much duplicated data we hold and also how much of it hasn't been accessed for X amount of time. Would also be nice to know what type of data we have, like a breakdown of '.doc', 'jpg', 'mpeg' etc...
Can anyone recommend any tools that can help provide me with this information?
Cheers!
Matt
This topic first appeared in the Spiceworks Community

Hi,
Trigger usage may affect the performance as we are handling Production environment.
is there any way to implement the scenario without using Triggers?
Any help will be needful for me

Similar Messages

  • I transferred data from my Macbook Pro to my Mac mini but it forced me to make a new user for my old data.  How do I transfer my music, pics, and docs from the "old" user to the new user (so that I only have one user instead of 2?)

    I transferred data from my Macbook Pro to my Mac mini but it forced me to make a new user for my old data.  How do I transfer my music, pics, and docs from the "old" user to the new user (so that I only have one user instead of 2?)

    Unless you transfer the files from Setup Assistant, Migration Assistant creates a new user with the data.
    To transfer the files to your first user, you have to log on this new user, and copy all your files to /Users/Shard folder. This is a folder where you can put the files you want to share between two or more users, and all users can read and write in it.
    After copying the files, go to your first user, open /Users/Shared folder, and copy the files to your user folders. If you migrated applications, you must know that they are stored in a common folder (/Applications), so you don't have to transfer them. To open /Users/Shared folder, open Go menu (in the menu bar) > Go to Folder, and type the folder

  • New SAP Tools for faster Master Data Upload?

    Hi All!
    I am interested in getting some detailed information on different tools that are used for faster master data upload. Please let me know about the tools apart from LSMW, BAPI, eCATT and BDC.
    We basically want to know the following things:
    1.Which are the tools available for this master data upload?
    for eg. SAP MDM, Info Shuttle, other available new age tools etc........
    2. Their performance / feature comparions?
    Please provide performance / feature comparison for different new age tools in detail.
    Thanking you in advance.
    Regards,

    Hi Amar,
    regarding SAP MDM you can read advantages and characteristics here: http://www.sap.com/platform/netweaver/components/mdm/index.epx
    Hope this help you,
    Vito

  • Monitoring and Alerting tools for Business Object Data Integrator

    Hi,
    We have Business Objects DI installed in AIX 5.3 environment. Please advise any type of monitoring and alerting tools for DI.
    Monitor tools to monitor Job servers(like job service and web services running properly) and also to monitor long running extraction jobs and alerting the same. Thanks.
    Thanks.
    Raj.

    Hi Thomas
    Though both the tools objectives are for Data integration, the purpose for both tools are different.
    SAP BODS/ BOBJ Data Integrator is an ETL tool which involves combining data residing in different sources and providing users with a unified view of the data
    SAP PI is a Middleware/EAI tool which have a mechanism/technology that connects different parts of an application or a series of applications
    SAP BOBJ Data Integrator
    Bulk Data Integration
    Extraction Transformation and Loading
    Deals of huge volume of data
    SAP PI
    It is process based integration of application data
    It is a middle ware which integrates various project applications into a common programming package that can be operate/access as a single application
    SAP NetWeaver PI is SAP’s implementation of Service-oriented Architecture (SOA) middleware and facilitates the integration of business processes that span different departments, organizations, or companies.
    SAP PI uses SAP NetWeaver Application Server and message servers where in fail over cases the messages can be resent again.
    The below differences will gives you more clarity
    Verdict is we can use both the tools for data transfer/migration and for choosing the tool depends upon the business requirement
    Please reply back if you need more information.
    Regards
    Murthy

  • MERGE Statement Problem for Storing Old Data

    Hi,
    I am using MERGE statement to update as well as insert rows on ta table.
    I have a data like in a table 'TABLEA' as 10 20 30 ABCD
    I want to update the table using 10 20 30 DEFG but i want the old data i.e 10 20 30 ABCD
    to store in a History table i.e TABLEA_H.
    Is there any way to store the data
    Any help will be needful for me

    Hi,
    Trigger usage may affect the performance as we are handling Production environment.
    is there any way to implement the scenario without using Triggers?
    Any help will be needful for me

  • Is SSAS the right tool for my active data monitoring?

    I'm looking for a solution for actively monitoring many millions of records for abnormalities in data trends.  I'm familiar with warehouses, star and snowflake schemas, all of that good stuff.  I'm really interested in SSAS as the front end tool
    or any other Microsoft tool that may lay on top of it.
    I have a ton of client databases, all with nearly identical structure, which have data loaded to them weekly or monthly.  I want to automatically monitor this data when it's loaded (when new records are added to the database, basically).  I would
    assume that this would be done through processing a cube periodically - I can trigger a reprocessing of the cube programmatically or whatever. I want to automatically get some kind of alerts when individual metrics that I have defined are outside of a threshold
    that I have defined (one field as a percentage of another, a standard deviation range as compared to previous months, etc).
    I have something like this in place already, but it's all home grown and becoming a maintenance nightmare.  We want to expand it to other areas, add more metrics to monitor, etc etc.  If there's a product out there (ideally SSAS which I already
    own a license for) that makes this more manageable that would be fantastic.
    Any other information you might be able to provide - articles, other product information, companion products, other tools, whatever - would be greatly appreciated also!  Thanks!

    I'm looking for a solution for actively monitoring many millions of records for abnormalities in data trends.  I'm familiar with warehouses, star and snowflake schemas, all of that good stuff.  I'm really interested in SSAS as the front end tool
    or any other Microsoft tool that may lay on top of it.
    I have a ton of client databases, all with nearly identical structure
    Hi Mateoc,
    In your scenario, you said that you have a ton of client databases, all with nearly identical structure,
    so you can use SQL Server Integration Services (SSIS) to load the data to Data Warehouse. Then create a SQL Server Analysis Services Multidimensional database using this data warehouse as the data source.
    SQL Server Analysis Services (SSAS) Multidimensional model is used when having large amount of data with complex requirements. In order to improve query performance, there will be a cube doing heavy time-consuming processing and then synchronize it
    to query cubes.
    Reference
    http://blog.aditi.com/data/choosing-between-analysis-services-multidimensional-and-tabular-models-part-3/
    http://blogs.technet.com/b/pfelatam/archive/2012/07/25/analysis-services-tabular-mode-vs-multidimensional-mode.aspx
    http://www.element61.be/e/resourc-detail.asp?ResourceId=485
    Regards,
    Charlie Liao
    TechNet Community Support

  • Development tools for using Spatial Data

    Hi everyone,
    What are the best tools that are used to develop the spatial applications that you guys are using/developing? Should I get something like eSpatial, or just develop in notepad?? Is there something else that uses your spatial data and can generate maps based on your data in your database?
    Any suggestions are appreciated.
    Thanks!
    -Scott

    Hi Daniel,
    Thanks!
    I am looking to develop a map of the US that shows the locations of military bases that we are responsible for monitoring. This map will have an icon near the name of each of the bases that is colored depending on if a trouble ticket has been created due to an outage or problem at the location. Example, red for a network outage, green if nothing is going on. What I am struggling with is where do I get all the geometry to create the map of the US, or can I just use images that are already created and specify the X and Y on that image and use long/lat of the bases and create the locations. This is not a topic I have a lot of experience in as you can see, but it is something I have been assigned to work on.
    Thanks!
    -Scott

  • Tool for Viewing 3D data in Oracle 10g

    Hi,
    I had uploaded the 3D DGN format Data from FME Oracle Suite to Oracle 10g database.
    the following tables were created
    TESTASH_SDODIM TABLE
    TESTASH_SDOLAYER TABLE
    TESTASH_SDOGEOM TABLE
    TESTASH_SDOINDEX TABLE
    TESTASH TABLE
    When we are trying to browse the data using AutoCAD of any other viewer, we are unable to find this table in that particular user. Whereas if we run a sql command and run a sql query we are able to get the record count.
    Can you suggest something to view this data.
    Thanks and Regards
    Ashish Dhawan

    Ok.. I'd bet then that there are no entries in USER_SDO_GEOM_METADATA AKA MDSYS.SDO_GEOM_METADATA_TABLE. FME view needs to find an entry in there to show you it in the dialog so you can pick the table. The same holds true for views of tables, there needs to be an entry, although I find it somewhat ironic that it then goes on to not know what projection the data is in.
    Also, the viewer will pick the first SDO_GEOMETRY column it finds. So if you have more than one, you will then need to make a view for just that column.
    Anyway, add an entry into the table, and you should be good to go.
    Bryan

  • Tool for creating sample data

    Greetings all,
    I have a application and I have some lookup tables used in the application for select lists etc... When I export the application I can get it to create the tables on installation but they are empty and I was wondering if there are instructions out there on how to have the data inserted into the table (Like the sample data is inserted in the OEHR Database). I know I can import the data from csv files after the application is installed, but wanted to have the lookup table populated when the application is deployed.
    I have been taking my application and installing it on other APEX instances, but then have to go in and import table data. I looked at the OEHR sample data build and I see that they do some insert into statements, but wanted to find out if there is an automated way to do this or some instructions out there to add this to the application sql file? There is much information in the OEHR sql file, and I don't know what is required or mandatory to make the insert into stuff work.
    Thanks in advance
    Wally
    Example table
    CategoryTable
    CategoryID (Number) PK
    CategoryName(VARCHAR2)(50)
    Data
    CategoryID CategoryName
    1 Cat1
    2 Cat2
    3 Cat3
    4 Cat4
    5 Cat5

    Thi sis what I do when I want to bundle supporting (lookup) table data.. I use SQL Developer to download a my table data as insert statements. I save those insert statements to a script and then add them to the application install file, via the supporting objects tab in APEX..
    See this site for more information: http://www.yocoya.com/downloads/apexsuppaper.pdf
    Thank you,
    Tony Miller
    Webster, TX
    Never argue with an idiot. They drag you down to their level, then beat you with experience.

  • Tools for data modeling

    Hi,
             Can any one tell me if there are any specific tools used for logical data modeling in SAP BW data modeling . I have used Erwin as a data modeling tool for implentation of data ware house, I would like to know if there are any specific tools for SAP BW implementations.
    Response appreciated
    tanu

    Another related discussion: Looking for EDW modelling tool recommendations for BW

  • Finding some tool for loading data

    I will finding some tools for loading, migrate
    data from another dbms like Access, DBF Files, Excel
    to Oracle Database
    Please suggess me
    Thank you
    Kachornsak

    I suppose the various sources will have various optimal solutions.
    Like in case you want to import from excel I would suggest to save your data to a csv and use import. (imp)
    For access files the best solution is the Oracle Migration Workbench.
    Best Regards,
    Kris

  • Purging Old Data

    pls help in solving one issue related to purging the data.
    There are some 40 tables in the database am working in. And I need to check these tables for data which is 5 years old and have to delete those data but these tables are interlinked with other tables (parent -child relation). So how to proceed with this.
    I thought of "with cascade" option but what if the record in the table with the relation is below 5 yrs time period (within 5 yrs data, should not be deleted) ?

    Aparna16 wrote:
    pls help in solving one issue related to purging the data.Interesting problem.. and one that I, wearing my DBA hat, will throw back at the developers.
    They know the data model. This request for purging old data is very likely to occur again in a year's time. What then? Go through a painful exercise again (this time taking data model changes since the last time into consideration)?
    I do not see the logic in that. So instead I will throw this back at the developer and tell them that a PL/SQL package needs to be designed and written to purge old data. DBA input into this will be ito design. Can a purge be done as a single massive delete transaction? Or make it more sense to design the purge for a specific date range? Or a specific product/invoice/customer/whatever business entity that can be aged? And then run multiple such purges in parallel?
    And why the purge? Is it to free up space? That may not be the case depending on the pctfree/pctused settings on a data block. So do some tables perhaps need to be rebuild after a purge in order to reorganise the table and free space?
    That's the DBA side of the problem. Figuring out what data can be deleted from which tables and writing code to do that - that's a developer problem.
    So either side, you need to make sure you use the other side to assist you in doing this task.

  • Oracle tools for speed up

    Does Oracle have more tool for speed up data (apart fromTimesTen and Oracle Coherence)?

    They are built-in in the database.
    You can refuse to use them, but that won't make the database any faster.
    It seems you are looking for 'Silver Bullets'. Those are usually pennywise and poundfoolish and only make 'consultants' rich.
    Sybrand Bakker
    Senior Oracle DBA
    Experts: Those who did read the documentation

  • Is the iCloud a backup tool for your computer?  How do I get my data back -- off the iCloud?

    Is the iCloud a backup tool for your computer?  ---- Apple care suggested using iCloud for a backup to my documents.  I do not have an iphone, ipad or laptop.  Just an iMac.  Nothing to share the data with.
    Now I am unable to access some of my documents on my computer and saving documents is cumbersome because it always wants to save it in iCloud, not my computer.  The documents I am unable to open are my old MS-Word.  One is a macro enabled word doc.   I am using os x mountain lion.
    After over an hour chat with apple care, the issue is not resolved.  I did not have more time to resolve the issue today and it will be continued next week.  Per apple care, I do not have any documents in the iCloud however I am almost at the free capacity with  contacts and documents.
    My question is -- If I purchase backup from a clould provider - other than apple, back up my files in documents in their cloud (make sure I can open them) and then delete the link to iCloud.  Would I preserve my data? Has anyone tried this?  I am open to suggestions.
    Thanks,
    Phyllis

    Is the iCloud a backup tool for your computer?  ---- Apple care suggested using iCloud for a backup to my documents.
    Not really. You can store "Documents in the Cloud" but this applies only to documents created by Pages, Numbers, Preview, Keynote, and Microsoft Office documents created on your computer stored in iCloud's "iWork". Within that limited purpose, iCloud works very well.
    My question is -- If I purchase backup from a clould provider - other than apple, back up my files in documents in their cloud (make sure I can open them) and then delete the link to iCloud.  Would I preserve my data?
    I'm not quite sure I understand what you mean by "purchase backup from a cloud provider" but if you're considering a service such as Carbonite, I don't advocate any of them. To back up your Mac, use your own backup device - Time Capsule or an external hard disk. It's inexpensive and reliable: two elements essential for a backup strategy, that no subscription service can offer.

  • How to i create a new itunes account for my old iphone so i can transfer data to new iphone, since my daughters new iphone is now linked to my acc and she ends up with all my apps and contacts etc

    My daughter has previously had an ipod which was linked to my itunes iphone account.
    she now has a new iphone and has linked this to that account and now she receives all my contacts apps etc when she syncs her account.
    How do i create a new itunes account for my old iphone so that i can transfer data to my new iphone and keep the two seperate so that when she deletes all my contacts and apps and then syncs her phone again we can still be compatible.

    iOS 5 & iCloud Tips: Sharing an Apple ID With Your Family

Maybe you are looking for