Managing huge data for  online news paper

Hi
I am currently working on a project for an online news paper. We at present are analysing the ways for managing the huge amount of data ie for current news and archives.
The best way so far in our mind, is storing them in the files in zip format. Can anyone please suggest us a more sophisticated and efficient way available.
Your help will be greatly appreciated. Suggestion for use of new technology is also welcome.
Thanks
keyur

Hi thanks for your help everyone.
watertownjordan that tip definitely helped. We are
also considering intermedia option as indicated by one
of other forum member. I will definitely keep you
posted as I am sure I will have other questions.::))).
I also did run your example posted on that site. yeah
it looks cool. But what we are thinking is we should
generate auto-Id. I am still puzzled why did you give
option to choose Id for the news or article. Because
it may clash and we will have to incorporate the check
in our programming (hence increased code and
processing). If you have it there for some specific
purpose I would be interested in knowing it.
Anyways thanks everyone for your valuable contribution
and I hope I will continue receving your help on this
topic in future.
keyurThanks alot. Glad you liked it. The program right now (completed in just 8 hours) is a sample of the articecture. It is for example purposes only now, I will be adding better functionality day by day. Be sure to check it out.
P.S. Would your newspaper be willing to talk about using my help, I don't cost much and I already have code. You see I am unemployed like the rest of the world. Need a little help.

Similar Messages

  • No Drop down Calendar Window when entering a date for a new event.

    Hi
    Hope someone can help with this annoying problem.
    In ICal when entering the date for a New Event a little window would pop up showing the month that you were creating the event in, you could then click on the date you required in the calender and it would then update the 'From' date field in your event. You could then do the same for the 'To' date field this was all very neat and fast, you could create event verys easily.
    However since upgrading to Snow Leopard this has stopped working and I can't see why.
    Does somone have answer ?
    Currently this works OK when using ICAL in MobileMe.
    Before I updated my iMAC to Snow Leopard recently but it seems that
    NOw when am s

    Have you figured out a solution to this? I am frustrated as well by lack of this feature.

  • How should i get the delta data for those new object's previous delta data?

    Hallo all,
    i have 2lis_11_vahdr and i am using a standard and loading delta! now i have appended some new fields in the datasource then in infosource then in ods and infocube..! now how should i get the delta data for those new object's previous delta data???
    Jimmy

    Hi,
    After appending new fields in the datasoure.It is not possible to delta load, u should have to load everything
    Thanks,
    Shreya

  • Windows Modified date for online redo logs

    I am doing a full database backup (oracle 10g) weekly and incremental backups nightly. The database is running in archivelog mode and I am multiplexing the online redo logs. However, when I look in windows the modified date for all Redo logs is displayed at the time the database was started up (Sunday night)... datafiles, controlfiles etc... show the latest modified date correctly.
    Is this normal that the modified date is not updating on redo logs or do I need to do something else to ensure my online redo is operating correctly.
    Any help would be appreciated.

    Redo3 was the setting before the switch... redo1 is now the current log. As regards the alert log... what file should I check... there is nothing showing in OEM.
    MEMBER
    GROUP# STATUS
    D:\ORACLE\PRODUCT\ORADATA\WATLI1\REDO03.LOG
    3 ACTIVE
    D:\ORACLE\PRODUCT\ORADATA\WATLI1\REDO02.LOG
    2 INACTIVE
    D:\ORACLE\PRODUCT\ORADATA\WATLI1\REDO01.LOG
    1 CURRENT
    MEMBER
    GROUP# STATUS
    E:\BACKUP\ONLINELOGS\REDO01_A.LOG
    1 CURRENT
    E:\BACKUP\ONLINELOGS\REDO02_A.LOG
    2 INACTIVE
    E:\BACKUP\ONLINELOGS\REDO03_A.LOG
    3 ACTIVE

  • How to use search REST api to get custom managed property data for anonymous user?

     
    I am trying build a public portal with anonymous access and i am trying to read some
    content from custom managed property using search REST api in sharepoint 2013. I have tried to enable all possible attributes of the managed prop. Like searchable,queryable,safe etc. also i am including queryparametertemplate in my REST api search query. But
    still i am not able to retrieve the managed prop. For an anonymous user. The same query returns the value if i am logged in.
    Any Help is greatly appreciated. 
    Thanks,
    Rakesh
    Thanks, Rakesh

    Hi Rakesh,
    To enable anonymous Search REST queries, we need to create queryparametertemplate.xml and upload it to the correct library in SharePoint.
    From your description I can know that you have created the file, then I recommend to check the things below:
    Please use “QueryTemplatePropertiesUrl” instead of “queryparametertemplate” in the Search REST API query as following: &QueryTemplatePropertiesUrl='spfile://webroot/queryparametertemplate.xml'.
    Make sure that the Query Properties you need have been added to the QueryProperties element in the queryparametertemplate.xml file.
    Make sure that the query parameters you need have been added to the WhiteList element in the
    queryparametertemplate.xml file. For example, if you want to use Refiners in the REST API, then the Refiners should be added to the
    WhiteList element in the queryparametertemplate.xml file as following:
    <a:string>Refiners</a:string>.
    You can also debug setting properties in anonymous Search Rest queries following the link below:
    http://www.mavention.com/blog/debugging-setting-properties-anonymous-search-rest-queries
    More references about anonymous Search REST:
    http://blog.mastykarz.nl/configuring-sharepoint-2013-search-rest-api-anonymous-users/
    http://msdn.microsoft.com/en-us/library/office/jj163876%28v=office.15%29.aspx#bk_AnonymousREST
    Thanks,
    Victoria
    Forum Support
    Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact
    [email protected]
    Victoria Xia
    TechNet Community Support

  • Save data for online pdf

    Hi!
    Don´t know if I doing this to complex, but I would like to work in an online pdf, and be able to save data - and on open i load the xml file.
    flow
    1) start form - lets say it has 10 fields
    2) fill out 5 fields and save data - export/submit it to a script that can save an xml on webserver
    3) on open, the pdf form opens with data. Could also be that an xdp was uploaded, which had a ref to pdf.
    Is there a better way - come with your surgetions! I would like the server-site script to be PHP, which a have a little experince with..
    Look forward to those clever ideas :)
    Thomas Groenbaek - Denmark

    No, you have to do it by creating duplicate and then renaming. In the Documents list, tap the Edit button, select the file, and tap the "Duplicate selected document" icon at the top, second from the left.
    To rename: Edit > select file > Rename (icon to the left of the trash can)

  • MDM for Managing Master data for PP & QM Modules

    We have studied the various offerings of SAP MDM for Materials, Suppliers, Financials
    These are definitely areas where we would like to automate using MDM  and thereby improve Quality, Turn around Time and eliminate errors, redundancy etc.
    In these  areas we have also succeeded to a some extent in controlling the maintenance process by way of centralizing and building checks and controls in the Configuration of different Modules.
    The main pain areas in terms of Master data have been in PP and QM Modules
    PP-   Maintenance of BoM and Recipe - which is based on process package finalized by R&D Section.
    R&D scientists are not so familiar with SAP and SAP Settings
    Process Package is usually a simple document- defining specific quantities of the different components required to produce a Specific quantity of a Product  and also descibles the procedure of the entire production process, but when it translates into a Recipe and Bom- different tables in SAP come into play.
    Eventually the BoMs and Recipes are created by manual input of information from the R&D Process Package
    Similarly the QM master data  - Inspection Plan in SAP -  is based on Specification finalized by the Quality wing of R&D
    R&D scientists are not so familiar with SAP and SAP Settings
    Specification  is usually a simple document defining the different tests to be performed for inspecting a material and the expected range in which the results should fall in order for the material to be accepted- but when it translates into a Recipe and Bom- different tables in SAP come into play.
    Eventually the Specifications are created by manual input of information from the R&D Process Package
    There is no direct relation between the original R&D Document and the SAP Master data- Verification is a laborious manual process.
    We are wondering whether SAP MDM would have the scope to cover these two areas
    Tks

    Hi Hari,
    If I understand correctly,you are doing a feasibility study about and trying to find out if standard offering in SAP MDM supports your requirement of linking the master data and R&D documents.
    If thats the case I guess you can design a solution based on your business requirement.For this you can either create a custom repository or extend the currently offered standard business content.You can link the documents to the master data,also store these as pdf/image/links etc.
    Thanks,
    Ravi

  • How can I change the default start-up date for a new functional location?

    Is there a way to change the default date when creating a functional location? Whenever we create a new functional location, there is a date populated in the start-up date field. This date is our go-live date from last year and I cannot find the location in the IMG (if there is one) to stop the date from automatically populating with the date from the superior functional location. I tried setting the field from input to required but the date still populates automatically. Does anyone have any suggestions on how to leave the start-up date field blank when creating a new functional location?

    That field is generally picked up from the immediate superior FL in the hierarchy through the inheritance functionality.You will have to overwrite this date.I dont think you can clear this field through Configuration functionality.
    If you are in Ecc 6.0, you could get the help of developer to use implicit enhancement to initialize the field contents.
    Regards
    Narasimhan

  • There is a estimated date for the new Mac Pro?

    Hi I'm going to buy a new Mac Pro in the next months, I'm trying to find if there is going to be a new mac pro to wait until then but i find almost no information. I would like to know if here i can find some.
    Thanks in advance

    http://www.macworld.com/article/1167247/cook_apple_planning_professional_mac_for _2013.html

  • Release date for new updates

    I'm super excited about the new features, especially the integration of C4D and AE, and adding looks in Premiere. I've looked for information about release dates but can't find any details. What's the release date for the new features?

    No official date yet but based on past releases it will likely be in the next month or two.

  • Smartform output in news paper format

    Hi All,
    How to print the data in the main window of a smartform in news paper format like First colum some data and second colum some data(after filling the first column data).
    Regards
    mahesh

    Hi,
    This can be done using table nodes with appropriate line types and table widths designed as per the news paper format.
    Also in what kind of structured way the data is passed onto the smartform interface matters here.
    Suppose you have the data required for the first column in a single table then use appropriate table width as required for the first column of the news paper format.
    Then adjacent to it use another table storing the data required for the second column.
    This way you can display the data in a news paper format.
    Regards,
    Ram

  • How we can manage SharePoint data if we have thousands and thousands of files in a Library

    Should we archive the data. If yes? How?
    Can we create hierarchy?
    It is the case if we have thousands and thousands of files in our SharePoint.
    Also what would be the best way to query the data in this case?
    Thanks

    Yes, archiving is an option to manage huge data. However there are some best practices available to manage huge content. Proper planning and structure will provide the best results. Term Store, Taxonomy and Metadata tagging will help to have structure
    for the information. Refer to the following posts for more information
    http://talkingsharepoint.sharepoint-videos.com/tag/sharepoint-big-data/
    http://www.sharepointgeoff.com/sharepoint-archiving-%E2%80%93-defining-a-way-forward/
    http://www.colligo.com/blog/sharepoint/how-should-you-manage-the-increasing-volume-of-content-in-sharepoint/
    --Cheers

  • Searching Huge data

    Hi,
    I have a table T1 with 5 key columns (c1,c2,c3,c4,c5) having Huge data
    (Datawarehouse)
    Each Incremental load is having 600 million records and stored in table T2 with same key columns (c1,c2,c3,c4,c5).
    I have to take every single record of T2 and search table T1 for the key columns.
    If found i have to switch the flag in T1 as "Old" for the already existing combination
    and load the current T2 load with "new". which will be stored finally in T1.
    I have worked out a way using "Rank() function" and connect by prior (Hierarchical query) which is working fine. 10 g also suggests some more options like Lag function. But as the size of T1 grows very huge for each every load the process is getting slower and slower.
    Can you please suggest a way or alternative?
    Thanks in advance

    Why are partitions faster? It's not even close. Just go to the Oracle documentation and look at that and you'll know.
    In brief though, since you can partition the indexes along with the data and you can have many (many, many in 11g!) partitions and you can subpartition the partitions, the explain plan can quickly rule out the VAST majority of that huge amount of data way up at the top of the query. For instance, if you had billions of records of credit card transactions and you wanted to search for all transactions from a certain card # within a certain date range and this huge voluminous table was partitioned by date monthly then by credit card # within each monthly partition then even though you may have 30 years worth of transactions, Oracle would never even consider scanning (index or otherwise) anything but the partitions that contain the date range in question. So rather than index scan a few billion records it index scans a few million maybe? Add parallelism to this (since Oracle on a multi-CPU box can search each partition in its own independedent "thread") and it is truly impressive.
    The other advantage is in loading data. You load/index the data for the new partition without having to touch the data/indexes in the existing partitions and then just add the new partition to the mix. Check it out!

  • Loading Historical data to the new field without deleting the data in cube

    Dear BI Experts,
    I have enhanced a new field to the Generic data source in BI 7.0 .
    I need to load historical data to the newly  appended field.
    As we are having very huge data it is not possible to delete and do init again.
    Is there any  other possibility to load the historical data for the new appeneded field without deleting the old requests?
    Thanks for your Kind  help.
    Kind Regards,
    Sunil

    Dear Sushant,
    Thanks for your reply.
    But I am just wondeing if there is any possibility of loading historical data for new field using Remodelling  concept
    with out deleting old requests.
    I do not know about Remodelling conept but heard that it is not recommeneded to use.
    Can you please suggest and help.
    Thanks and Regards,
    Sunil Kotne

  • Bank Master Data ( Creation of new Account )....

    Dear SAP Gurus,
       Good morning to all,i have one doubt regarding creating a new Bank Master Data in Production, please help me.My user has a requirement which is like one Cash Credit Account has been opened with SBI bank where with the same bank and branch there is already an existing Current Account,now my client wants from me to create a bank master data for the new bank Cash Credit  Account( as he is saying that he has to maintain BRS).
       Now i have to know that what is the best practice in sap whether i should create one more  master data for the new Account or i should attach the new account with the existing Bank Master?
    Please help it is urgent.I'll be waiting for your valuable suggestion.
    Regards
    Rajiv Kapur

    Hi Rajiv,
    Creation of new house bank will not serve purpose in better way, it is only required when there is a complext scenatio in check printing but that does not appear in your case.
    So, create a new Bank Account in the existing House Bank, this will be included in Bank Reconciliation. Moreover, creation of Bank account instead of House Bank will also ease some maintainance in Bank Reconciliation statement configuration.
    Regards,
    Chintan Joshi

Maybe you are looking for