Managing huge data for online news paper
Hi
I am currently working on a project for an online news paper. We at present are analysing the ways for managing the huge amount of data ie for current news and archives.
The best way so far in our mind, is storing them in the files in zip format. Can anyone please suggest us a more sophisticated and efficient way available.
Your help will be greatly appreciated. Suggestion for use of new technology is also welcome.
Thanks
keyur
Hi thanks for your help everyone.
watertownjordan that tip definitely helped. We are
also considering intermedia option as indicated by one
of other forum member. I will definitely keep you
posted as I am sure I will have other questions.::))).
I also did run your example posted on that site. yeah
it looks cool. But what we are thinking is we should
generate auto-Id. I am still puzzled why did you give
option to choose Id for the news or article. Because
it may clash and we will have to incorporate the check
in our programming (hence increased code and
processing). If you have it there for some specific
purpose I would be interested in knowing it.
Anyways thanks everyone for your valuable contribution
and I hope I will continue receving your help on this
topic in future.
keyurThanks alot. Glad you liked it. The program right now (completed in just 8 hours) is a sample of the articecture. It is for example purposes only now, I will be adding better functionality day by day. Be sure to check it out.
P.S. Would your newspaper be willing to talk about using my help, I don't cost much and I already have code. You see I am unemployed like the rest of the world. Need a little help.
Similar Messages
-
No Drop down Calendar Window when entering a date for a new event.
Hi
Hope someone can help with this annoying problem.
In ICal when entering the date for a New Event a little window would pop up showing the month that you were creating the event in, you could then click on the date you required in the calender and it would then update the 'From' date field in your event. You could then do the same for the 'To' date field this was all very neat and fast, you could create event verys easily.
However since upgrading to Snow Leopard this has stopped working and I can't see why.
Does somone have answer ?
Currently this works OK when using ICAL in MobileMe.
Before I updated my iMAC to Snow Leopard recently but it seems that
NOw when am sHave you figured out a solution to this? I am frustrated as well by lack of this feature.
-
How should i get the delta data for those new object's previous delta data?
Hallo all,
i have 2lis_11_vahdr and i am using a standard and loading delta! now i have appended some new fields in the datasource then in infosource then in ods and infocube..! now how should i get the delta data for those new object's previous delta data???
JimmyHi,
After appending new fields in the datasoure.It is not possible to delta load, u should have to load everything
Thanks,
Shreya -
Windows Modified date for online redo logs
I am doing a full database backup (oracle 10g) weekly and incremental backups nightly. The database is running in archivelog mode and I am multiplexing the online redo logs. However, when I look in windows the modified date for all Redo logs is displayed at the time the database was started up (Sunday night)... datafiles, controlfiles etc... show the latest modified date correctly.
Is this normal that the modified date is not updating on redo logs or do I need to do something else to ensure my online redo is operating correctly.
Any help would be appreciated.Redo3 was the setting before the switch... redo1 is now the current log. As regards the alert log... what file should I check... there is nothing showing in OEM.
MEMBER
GROUP# STATUS
D:\ORACLE\PRODUCT\ORADATA\WATLI1\REDO03.LOG
3 ACTIVE
D:\ORACLE\PRODUCT\ORADATA\WATLI1\REDO02.LOG
2 INACTIVE
D:\ORACLE\PRODUCT\ORADATA\WATLI1\REDO01.LOG
1 CURRENT
MEMBER
GROUP# STATUS
E:\BACKUP\ONLINELOGS\REDO01_A.LOG
1 CURRENT
E:\BACKUP\ONLINELOGS\REDO02_A.LOG
2 INACTIVE
E:\BACKUP\ONLINELOGS\REDO03_A.LOG
3 ACTIVE -
How to use search REST api to get custom managed property data for anonymous user?
I am trying build a public portal with anonymous access and i am trying to read some
content from custom managed property using search REST api in sharepoint 2013. I have tried to enable all possible attributes of the managed prop. Like searchable,queryable,safe etc. also i am including queryparametertemplate in my REST api search query. But
still i am not able to retrieve the managed prop. For an anonymous user. The same query returns the value if i am logged in.
Any Help is greatly appreciated.
Thanks,
Rakesh
Thanks, RakeshHi Rakesh,
To enable anonymous Search REST queries, we need to create queryparametertemplate.xml and upload it to the correct library in SharePoint.
From your description I can know that you have created the file, then I recommend to check the things below:
Please use “QueryTemplatePropertiesUrl” instead of “queryparametertemplate” in the Search REST API query as following: &QueryTemplatePropertiesUrl='spfile://webroot/queryparametertemplate.xml'.
Make sure that the Query Properties you need have been added to the QueryProperties element in the queryparametertemplate.xml file.
Make sure that the query parameters you need have been added to the WhiteList element in the
queryparametertemplate.xml file. For example, if you want to use Refiners in the REST API, then the Refiners should be added to the
WhiteList element in the queryparametertemplate.xml file as following:
<a:string>Refiners</a:string>.
You can also debug setting properties in anonymous Search Rest queries following the link below:
http://www.mavention.com/blog/debugging-setting-properties-anonymous-search-rest-queries
More references about anonymous Search REST:
http://blog.mastykarz.nl/configuring-sharepoint-2013-search-rest-api-anonymous-users/
http://msdn.microsoft.com/en-us/library/office/jj163876%28v=office.15%29.aspx#bk_AnonymousREST
Thanks,
Victoria
Forum Support
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact
[email protected]
Victoria Xia
TechNet Community Support -
Hi!
Don´t know if I doing this to complex, but I would like to work in an online pdf, and be able to save data - and on open i load the xml file.
flow
1) start form - lets say it has 10 fields
2) fill out 5 fields and save data - export/submit it to a script that can save an xml on webserver
3) on open, the pdf form opens with data. Could also be that an xdp was uploaded, which had a ref to pdf.
Is there a better way - come with your surgetions! I would like the server-site script to be PHP, which a have a little experince with..
Look forward to those clever ideas :)
Thomas Groenbaek - DenmarkNo, you have to do it by creating duplicate and then renaming. In the Documents list, tap the Edit button, select the file, and tap the "Duplicate selected document" icon at the top, second from the left.
To rename: Edit > select file > Rename (icon to the left of the trash can) -
MDM for Managing Master data for PP & QM Modules
We have studied the various offerings of SAP MDM for Materials, Suppliers, Financials
These are definitely areas where we would like to automate using MDM and thereby improve Quality, Turn around Time and eliminate errors, redundancy etc.
In these areas we have also succeeded to a some extent in controlling the maintenance process by way of centralizing and building checks and controls in the Configuration of different Modules.
The main pain areas in terms of Master data have been in PP and QM Modules
PP- Maintenance of BoM and Recipe - which is based on process package finalized by R&D Section.
R&D scientists are not so familiar with SAP and SAP Settings
Process Package is usually a simple document- defining specific quantities of the different components required to produce a Specific quantity of a Product and also descibles the procedure of the entire production process, but when it translates into a Recipe and Bom- different tables in SAP come into play.
Eventually the BoMs and Recipes are created by manual input of information from the R&D Process Package
Similarly the QM master data - Inspection Plan in SAP - is based on Specification finalized by the Quality wing of R&D
R&D scientists are not so familiar with SAP and SAP Settings
Specification is usually a simple document defining the different tests to be performed for inspecting a material and the expected range in which the results should fall in order for the material to be accepted- but when it translates into a Recipe and Bom- different tables in SAP come into play.
Eventually the Specifications are created by manual input of information from the R&D Process Package
There is no direct relation between the original R&D Document and the SAP Master data- Verification is a laborious manual process.
We are wondering whether SAP MDM would have the scope to cover these two areas
TksHi Hari,
If I understand correctly,you are doing a feasibility study about and trying to find out if standard offering in SAP MDM supports your requirement of linking the master data and R&D documents.
If thats the case I guess you can design a solution based on your business requirement.For this you can either create a custom repository or extend the currently offered standard business content.You can link the documents to the master data,also store these as pdf/image/links etc.
Thanks,
Ravi -
How can I change the default start-up date for a new functional location?
Is there a way to change the default date when creating a functional location? Whenever we create a new functional location, there is a date populated in the start-up date field. This date is our go-live date from last year and I cannot find the location in the IMG (if there is one) to stop the date from automatically populating with the date from the superior functional location. I tried setting the field from input to required but the date still populates automatically. Does anyone have any suggestions on how to leave the start-up date field blank when creating a new functional location?
That field is generally picked up from the immediate superior FL in the hierarchy through the inheritance functionality.You will have to overwrite this date.I dont think you can clear this field through Configuration functionality.
If you are in Ecc 6.0, you could get the help of developer to use implicit enhancement to initialize the field contents.
Regards
Narasimhan -
There is a estimated date for the new Mac Pro?
Hi I'm going to buy a new Mac Pro in the next months, I'm trying to find if there is going to be a new mac pro to wait until then but i find almost no information. I would like to know if here i can find some.
Thanks in advancehttp://www.macworld.com/article/1167247/cook_apple_planning_professional_mac_for _2013.html
-
I'm super excited about the new features, especially the integration of C4D and AE, and adding looks in Premiere. I've looked for information about release dates but can't find any details. What's the release date for the new features?
No official date yet but based on past releases it will likely be in the next month or two.
-
Smartform output in news paper format
Hi All,
How to print the data in the main window of a smartform in news paper format like First colum some data and second colum some data(after filling the first column data).
Regards
maheshHi,
This can be done using table nodes with appropriate line types and table widths designed as per the news paper format.
Also in what kind of structured way the data is passed onto the smartform interface matters here.
Suppose you have the data required for the first column in a single table then use appropriate table width as required for the first column of the news paper format.
Then adjacent to it use another table storing the data required for the second column.
This way you can display the data in a news paper format.
Regards,
Ram -
How we can manage SharePoint data if we have thousands and thousands of files in a Library
Should we archive the data. If yes? How?
Can we create hierarchy?
It is the case if we have thousands and thousands of files in our SharePoint.
Also what would be the best way to query the data in this case?
ThanksYes, archiving is an option to manage huge data. However there are some best practices available to manage huge content. Proper planning and structure will provide the best results. Term Store, Taxonomy and Metadata tagging will help to have structure
for the information. Refer to the following posts for more information
http://talkingsharepoint.sharepoint-videos.com/tag/sharepoint-big-data/
http://www.sharepointgeoff.com/sharepoint-archiving-%E2%80%93-defining-a-way-forward/
http://www.colligo.com/blog/sharepoint/how-should-you-manage-the-increasing-volume-of-content-in-sharepoint/
--Cheers -
Hi,
I have a table T1 with 5 key columns (c1,c2,c3,c4,c5) having Huge data
(Datawarehouse)
Each Incremental load is having 600 million records and stored in table T2 with same key columns (c1,c2,c3,c4,c5).
I have to take every single record of T2 and search table T1 for the key columns.
If found i have to switch the flag in T1 as "Old" for the already existing combination
and load the current T2 load with "new". which will be stored finally in T1.
I have worked out a way using "Rank() function" and connect by prior (Hierarchical query) which is working fine. 10 g also suggests some more options like Lag function. But as the size of T1 grows very huge for each every load the process is getting slower and slower.
Can you please suggest a way or alternative?
Thanks in advanceWhy are partitions faster? It's not even close. Just go to the Oracle documentation and look at that and you'll know.
In brief though, since you can partition the indexes along with the data and you can have many (many, many in 11g!) partitions and you can subpartition the partitions, the explain plan can quickly rule out the VAST majority of that huge amount of data way up at the top of the query. For instance, if you had billions of records of credit card transactions and you wanted to search for all transactions from a certain card # within a certain date range and this huge voluminous table was partitioned by date monthly then by credit card # within each monthly partition then even though you may have 30 years worth of transactions, Oracle would never even consider scanning (index or otherwise) anything but the partitions that contain the date range in question. So rather than index scan a few billion records it index scans a few million maybe? Add parallelism to this (since Oracle on a multi-CPU box can search each partition in its own independedent "thread") and it is truly impressive.
The other advantage is in loading data. You load/index the data for the new partition without having to touch the data/indexes in the existing partitions and then just add the new partition to the mix. Check it out! -
Loading Historical data to the new field without deleting the data in cube
Dear BI Experts,
I have enhanced a new field to the Generic data source in BI 7.0 .
I need to load historical data to the newly appended field.
As we are having very huge data it is not possible to delete and do init again.
Is there any other possibility to load the historical data for the new appeneded field without deleting the old requests?
Thanks for your Kind help.
Kind Regards,
SunilDear Sushant,
Thanks for your reply.
But I am just wondeing if there is any possibility of loading historical data for new field using Remodelling concept
with out deleting old requests.
I do not know about Remodelling conept but heard that it is not recommeneded to use.
Can you please suggest and help.
Thanks and Regards,
Sunil Kotne -
Bank Master Data ( Creation of new Account )....
Dear SAP Gurus,
Good morning to all,i have one doubt regarding creating a new Bank Master Data in Production, please help me.My user has a requirement which is like one Cash Credit Account has been opened with SBI bank where with the same bank and branch there is already an existing Current Account,now my client wants from me to create a bank master data for the new bank Cash Credit Account( as he is saying that he has to maintain BRS).
Now i have to know that what is the best practice in sap whether i should create one more master data for the new Account or i should attach the new account with the existing Bank Master?
Please help it is urgent.I'll be waiting for your valuable suggestion.
Regards
Rajiv KapurHi Rajiv,
Creation of new house bank will not serve purpose in better way, it is only required when there is a complext scenatio in check printing but that does not appear in your case.
So, create a new Bank Account in the existing House Bank, this will be included in Bank Reconciliation. Moreover, creation of Bank account instead of House Bank will also ease some maintainance in Bank Reconciliation statement configuration.
Regards,
Chintan Joshi
Maybe you are looking for
-
I have an old iPad2, and received a new iPad Air. When I set up the iPad Air, I started as a backup from the iPad2, instead of treating it as a new iPad setup. It also asked if I wanted to set up Find My iPhone and I said yes. Problem is that I also
-
SAPscript Output Problem - Very Urgent - Please help
Hi, I am having the following problem with SAPscript. In the Main Window, I have instructions to the printer in the ZPL2 language (For Zebra Printer). There are also several variables, which are highlighted in Gray and enclosed in the&. There are a
-
Firefox fills complete screen - no close box - can't shut down, etc. Makes it worthless
Opening firefox, takes me to default program Yahoo which opens to total full screen thus not showing any tool bars, no URL address field, and nothing at the bottom of screen either. Cant' even shut down properly. Downloaded the latest version and not
-
Hi my newly bought iMac suddenly won't power on. Don't know what to do
My brand new iMac doesn't turn on on the next day
-
H.264 streaming in flash player motion blur
Hi , We are using H.264 for live streaming in a flash window . The encoding works fine but when there is alot of fast movement on the stream there is a degradation in the quality of the video. When the fast movement stops the video restores itself bu