Need help estimating processing power required to support new process
Hi,
I am putting up a new server spec for a new project. I need help estimating processor power I need.
Here are, in short, the steps of the main process:
- Load the data:
Incoming file contains 160 mln rows. The SIZE of this file is 250 GB. The file has about 60 columns, out of that I upload 50 into my table.
Record length is 1500 bytes, in the table.
- Validation/calculations:
After the upload I validate EACH row in this table against 20 rules that are defined in the RULES table.
It is all math, like this column plus that column must be equal to this number, and validate the third column against this number.
- Output stage:
Records that pass validation go to one table, those that didn't go to the other table.
Then the first table (with good records) is extracted to a file. Those from the "wrong" table are also get inserted into "review" table
This whole process should take about 5-6 hrs.
This file contains 6 month of data.
Some times, I will run validation against 2 year worth of data, means validate two "annual" tables, each one is 500 GB in size. According to the requirements, this process should take no more than 1 day.
For this process I write hardware spec for a new server.
I have a hard time figuring out how much processor power I need for this process? to validate this much data in that much time.
Is there any formula or a guideline to tell what processor I need? I was looking at this one, but I wish I could estimate before I buy and try (and possibly fail, and have a biiiiig problems)
Intel Xeon E5-2640 (6 core, 2.50 GHz, 15MB, 95W)
Number of processors: 2
RAM: 16GB
Any help is very appreciated.
Thanks in advance
Edited by: 933238 on Jun 13, 2012 12:25 PM
Edited by: 933238 on Jun 13, 2012 12:28 PM
Hello Ajay,
Please have a look to these blogs (the second one should be particularly interesting regarding your request) :
/people/kamran.ellahi2/blog/2006/01/13/setting-up-sap-service-desk-123-and-go
/people/dolores.correa/blog/2007/10/06/service-desk-support-team-determination
Hope this helps.
BR.
Stéphane.
Similar Messages
-
I really need help. I try to contact support to no avail. There simply is no option on the site, You are always referred to a further topic which has notihing to do with my problem. I bougnt a full master pack CS6 which I had installed on a mac for one year. Then, I decided to change it to another computer, so I sisintalled it according to instructions. In the meantime I got a free trial of creative cloud on that computer, but I gave up and decided to reinstall my cd-roms. However, everytime I try to use acrobat for instance it says that my trial period ran out! I disinstalled my cloud products, I am using my registered full master series items, they have nothing whatsoever to do with my creative cloud FREE subscription. If I try to cancel my free membership, it is to no avail, there simply is no such possiblity. I want to use the software I paid dearly for, not the cloud items I disinstalled and which do not interest me. How can I contact Adobe to fix it? It was no fault of mine, I did all I was supposed to, disintalling items before installing the right ones, but the system must have some error i am not responsible for.
open an app and click help>activate.
if you try to open an app and see a 'your trial has expired" window, click license this software and enter your serial number.
if you can't do either, run the cleaner and make sure cc is cleaned from your computer, Use the CC Cleaner Tool to solve installation problems | CC, CS3-CS6 -
I need help installing windows 8.1 on my new laptop help me
i need help installing windows 8.1 on my new laptop Hp Pavilion g7-2298nr help me it installs from store no problem then ask to restart then i restart it it gets stuck at windows logo and drive light on side not blinking i have shut down then it starts fine how to fix this problem so i can get it to install i need do it tonight reply before 8pm
Hello,
Thank you for posting in the HP Support Forum.
Your computer comes with Win 8 pre-installed but one of the steps to install/run Windows 8.1 is having updated drivers for Windows 8.1
Please, go to Control Panel -> System (or Start -> type winver and open) and verify what is your current version - if it is Windows 8 or 8.1
Windows 8 is version 6.2.x
Windows 8.1 is version 6.3.x
If Windows 8 in place, then , please read this article and enroll in the steps:
http://www8.hp.com/us/en/pdf/instruct_update_win8.1_EN_tcm_245_1508074.pdf
Update to the latest drivers prior and post installation respectively for win 8/8.1 :
http://support.hp.com/us-en/product/HP-Pavilion-g7-2200-Notebook-PC-series/5296086/model/5333384/dri...
Best wishes,
IT_WinSec
Hewlett-Packard employee | HP Enterprise Services
Although I work for HP, I express my personal opinion.
Visit www.hp.com/makeitmatter
--Say "Thanks" by clicking the Kudos Thumb Up in the post that you find useful.
--Please mark the post that solves your problem as "Accepted Solution" -
I need help to reload my purchases to my new mac!
I need help to reload my purchases to my new mac! My other mac harddisk died withou warning.
When I log on to itunes store with my apple ID>purchased (new) i only get the lists for apps and books. Not music. Anybody know a different way to redownload my songs ??Currently music purchases can only be re-downloaded if you are in the US. If you aren't in the US then have you got a backup of your purchases on external drives and/or another computer ?
-
Need help re installing PS CS 6 on new windows 8 PC. have product key. HELP!! Please and thank you.
Downloadable installation files available:
Suites and Programs: CC 2014 | CC | CS6 | CS5.5 | CS5 | CS4, CS4 Web Standard | CS3
Acrobat: XI, X | 9,8 | 9 standard
Premiere Elements: 13 | 12 | 11, 10 | 9, 8, 7 win | 8 mac | 7 mac
Photoshop Elements: 13 |12 | 11, 10 | 9,8,7 win | 8 mac | 7 mac
Lightroom: 5.7.1| 5 | 4 | 3
Captivate: 8 | 7 | 6 | 5.5, 5
Contribute: CS5 | CS4, CS3
Download and installation help for Adobe links
Download and installation help for Prodesigntools links are listed on most linked pages. They are critical; especially steps 1, 2 and 3. If you click a link that does not have those steps listed, open a second window using the Lightroom 3 link to see those 'Important Instructions'. -
Need help to restore my caller ID on new replaced sim card... iphone network won't switch feature on
cathorio wrote:
I recently changed my lap top. My problem is the new lap top won't accept my apple I D it asked me to sing up for a new one which I did.
I am puzzled by this. The laptop doesn't need the Apple ID - but iTunes does. I could be missing something but ....
Why would you not be able to use your existing Apple ID and iTunes account on a new laptop? If you authorized the computer - you should be able to use your existing account - unless you already had 5 computers authorized with the existing ID - and that was why iTunes would not accept the ID. However, I'm sure that you would have received a popup message from iTunes telling you that you had reached the limit.
I just received a new MBP and my daughter did as well. My entire family shares an Apple ID and we had no issues at all with my Apple ID and iTunes on our new computers and I did not have to sign up for a new account. Did you even try the old ID? -
I need help whenever I want to install a new application I receive a message that I cannot be connected to I tunes store although I am connected to the Internet Help
Click here and follow the instructions to change the iTunes Store country.
(85848) -
I need help finding a power supply
I need to find a power supply that is compatible with my Compaq Presario SR5816F
It needs to have a minimum output of 12v @ 18 amps and have at leaast 350 wattts...
thanks.
This question was solved.
View Solution.See my reply to your later thread:
http://h30434.www3.hp.com/t5/Desktop-Hardware/Will-this-power-supply-work-with-my-PC/m-p/4292292#M85...
Signature:
HP TouchPad - 1.2 GHz; 1 GB memory; 32 GB storage; WebOS/CyanogenMod 11(Kit Kat)
HP 10 Plus; Android-Kit Kat; 1.0 GHz Allwinner A31 ARM Cortex A7 Quad Core Processor ; 2GB RAM Memory Long: 2 GB DDR3L SDRAM (1600MHz); 16GB disable eMMC 16GB v4.51
HP Omen; i7-4710QH; 8 GB memory; 256 GB San Disk SSD; Win 8.1
HP Photosmart 7520 AIO
++++++++++++++++++
**Click the Thumbs Up+ to say 'Thanks' and the 'Accept as Solution' if I have solved your problem.**
Intelligence is God given; Wisdom is the sum of our mistakes!
I am not an HP employee. -
Need help hp 520 power on password ican' break it
pls help hp 520 power on password i try reset in bios still on power on password
pls help hp 520 power on password i try reset in bios still on power on password
-
Need HELP with setting up my email on new 4g ipod touch.
I need help setting up my email on my 4g ipod touch. I just got it today and had a 1st gen and it worked fine. I need help setting it up again.
Any help would be appreciated
Thanks in advance.
Pamhttp://www.apple.com/support/ipodtouch/assistant/sendmail/
-
hi there! can somebody please help me. I can't receive new messages in my MacBook Pro, what should I do? I can read them in my IPhone though. Thanx!
Yes I was able to send but not receive - I actually was able to solve it myself
Everything on the menu bar was greyed out - so nothing there helped me @ all
Connection Doctor didn't show anything wrong
activity box was completely blank
shutdown - restart didn't work
I used the help option - still nothing
All the while my phone was vibrating like crazy with new emails
It was really frustrating & it seemed apple themselves don't have any real solutions to offer
My instincts told me to delete the email completely - so I did
After a few min I added the email account like a new one and it eventually worked - all my new emails were there, I still don't know why it stopped in the 1st place
Pretty much all the problems I run into I troubleshoot myself and find the solution -
Need help in configuring Cisco AP to support EAP authentication
Hello all,
in desperation after trying for more than 3 weeks, I am trying in this way to get a solution to my following problem.
I am trying to build up as 802.1x scenario using 802.11b infrastructure (RADIUS server, Cisco 1100 Aironet AP, Cisco PCMCIA WLAN card with Xsupplicant software, the complete OS is Linux). I am trying to use EAP-MD5 authentication. It seems that the things are funtioning in standalone mode.
The client wants to authenticate to access WLAN. It sends EAPoL start packet and gets a request from AP for user identity. Good. Then the user sends his identity with EAP packet. The Cisco AP is forwarding the request to RDAIUS server as specified in many documents. It is also Good. RADIUS server is sending a request for challenge (Password). Upto this point things are gooing fine.
Now the Cisco AP is not sending this challenge to the
Xsupplicant, it is just ignoring it. Can any one help me in this point. If needed I can also send the configuration file of the AP.
I would be very thankful, if I could solve this Problem with your support.
Thanking you in advance,
FelixAs per the RFC for RADIUS, a RADIUS Server receiving an Access-Request with a Message- Authenticator Attribute present MUST calculate the correct value of the Message-Authenticator and silently discard the packet if it does not match the value sent. A RADIUS Client receiving an Access-Accept, Access-Reject or Access-Challenge with a Message-Authenticator Attribute present MUST calculate the correct value of the Message-Authenticator and silently discard the packet if it does not match the value sent.
-
Need help w/ G4 Power Mac PLEASE!
I bought a used & ancient I know Mac for my kids to use for school project ect. It is a G4 Power Mac. It came w/ all the originial cd's. The guy told me they had been using it mainly his kids as well but he took everything off it & cleaned it to original. I am trying to reinstall the software. When I put the 1st disc in & I followed the instructions of restarting the computer & holding down the C key. It gets to this blue screen that looks like a little man holding a sword all over it & nothing comes up. Any help appreciated! THANKS!
Hello,
Could it be a spinning gray radian?
http://support.apple.com/kb/TS2570
Hold the Option/alt key at powerup, what choices does it show for a boot source? -
Im considering buying a power mac G5 but only cuz its all i can afford and i got an idea about hooking ut up to my tv but i would want to be able to use a wireless keyboard and traction pad but i did some reserch online and found out i need a airport extreme with 2.0 EDR to enable bluetooth which is a requirement for the wireless keyboard. Where can I find the AirPort Extreme with Bluetooth 2.0+EDR card? There dosent seem to be any place online that sells it and lets say I do install the airport extreme card and enable wifi on a power Mac G5, will I be able to use a apple wireless keyboard with it? And just a side question, for the age of the computer what OS should I have installed, I'm not to femilliar with apple software, the only apple products I have are old iPods n a 4s. Oh and I would mainly use it for going online, a little bit of vid editing, watching YouTube vids, homework and uploading and listing to music, I would love to wirelessly sync my iPhone to the power Mac wirelessly.
Forgot Your Account Password
For Lion, Mountain Lion, or Mavericks
Boot to the Recovery HD:
Restart the computer and after the chime press and hold down the COMMAND and R keys until the menu screen appears. Alternatively, restart the computer and after the chime press and hold down the OPTION key until the boot manager screen appears. Select the Recovery HD and click on the downward pointing arrow button.
When the menubar appears select Terminal from the Utilities menu.
Enter resetpassword at the prompt and press RETURN. Follow
instructions in the dialog window that will appear.
Or see:
Reset a Mac OS X 10.7 Lion Password
OS X Mountain Lion- Reset a login password,
OS X Mavericks- Solve password problems,
OS X Lion- Apple ID can be used to reset your user account password.
For Snow Leopard and earlier with installer DVD
Mac OS X 10.6- If you forget your administrator password,
OS X- Changing or resetting an account password (Snow Leopard and earlier).
For Snow Leopard and earlier without installer DVD
How to reset your Mac OS X password without an installer disc | MacYourself
Reset OS X Password Without an OS X CD — Tech News and Analysis
How To Create A New Administrator Account - Hack Mac -
Need help in triggering the Data stream load using process chain
Hi Guru's
is it possible to trigger a data stream load using process chain?
Any help is highly appreciated.
Thanks
IndiranHi Indiran and welcome aboard!
Don't think this is possible. SAP BW & SAP SEM-BCS are rather independent systems. Though, BCS lives on top of BI-BW stack, it even may have master data different from those in BW.
Process chains, AFAIK, is completely the BW's feature. Certainly, you may use PCc on BW side, loading ODS/DSO and cubes involved in BCS data model.
The main con here is the lost transparency -- you don't control everything from the consolidation monitor.
The pro side is also rather obvious for me. Since, very often there is a huge difference between data quality at the data source and in the BCS totals cube, I need to make a lot of data transformation. Not only some data calculations or cleaning, but also transformation of data model: key figure model -> account model. It's much more easier to do in BW, for me.
I even call the ODS/cubes/routines involved in such transformation as intermediate layer, the layer between data source and SEM-BCS.
And this layer lives rather independently from BCS.
Hope this helps.
Maybe you are looking for
-
RwTemplates.xml file not able to be opened
When I attempt to specify a style templete using the report wizard I get an Rep-0110 error that the rwTemplates.xml file cannot be opened. I can see the file but am not sure what the difficulty is. Has anyone had this problem?
-
My photo library shows 0 bytes and photo stream only shows 3.6kb. I know 65 pics aren't using up 5.4gb of space. Any idea how I can fix this?
-
Stolen iPhone, Apple care on the new one?
Hello. I'm sure it's not posted in the good community, but I have no idea where else to post it. I recently got my iPhone stolen with an Apple Care warranty. I know my phone is lost into the woods, but now, I just want to know if there's a possibilit
-
My keyboard clicks and ringer volume have disappeared. I have tried plugging in the head phones many times, blowing air in the headphone jack, credit card in the charger jack, everything on you tube basically! To no avail! Any suggestions?
-
Hello. I'm having a problem with the time format in the xml forms generated from one of the pdf forms I have made in live cycle. The time is already set to be HH:MM:SS, but when my users are submitting at e.g. 8:00 the time in the xml file is 8:00:00