Need help estimating processing power required to support new process

Hi,
I am putting up a new server spec for a new project. I need help estimating processor power I need.
Here are, in short, the steps of the main process:
- Load the data:
Incoming file contains 160 mln rows. The SIZE of this file is 250 GB. The file has about 60 columns, out of that I upload 50 into my table.
Record length is 1500 bytes, in the table.
- Validation/calculations:
After the upload I validate EACH row in this table against 20 rules that are defined in the RULES table.
It is all math, like this column plus that column must be equal to this number, and validate the third column against this number.
- Output stage:
Records that pass validation go to one table, those that didn't go to the other table.
Then the first table (with good records) is extracted to a file. Those from the "wrong" table are also get inserted into "review" table
This whole process should take about 5-6 hrs.
This file contains 6 month of data.
Some times, I will run validation against 2 year worth of data, means validate two "annual" tables, each one is 500 GB in size. According to the requirements, this process should take no more than 1 day.
For this process I write hardware spec for a new server.
I have a hard time figuring out how much processor power I need for this process? to validate this much data in that much time.
Is there any formula or a guideline to tell what processor I need? I was looking at this one, but I wish I could estimate before I buy and try (and possibly fail, and have a biiiiig problems)
Intel Xeon E5-2640 (6 core, 2.50 GHz, 15MB, 95W)
Number of processors: 2
RAM: 16GB
Any help is very appreciated.
Thanks in advance
Edited by: 933238 on Jun 13, 2012 12:25 PM
Edited by: 933238 on Jun 13, 2012 12:28 PM

Hello Ajay,
Please have a look to these blogs (the second one should be particularly interesting regarding your request) :
/people/kamran.ellahi2/blog/2006/01/13/setting-up-sap-service-desk-123-and-go
/people/dolores.correa/blog/2007/10/06/service-desk-support-team-determination
Hope this helps.
BR.
Stéphane.

Similar Messages

  • I really need help. I try to contact support to no avail. There simply is no option on the site, You are always referred to a further topic which has notihing to do with my problem. I bougnt a full master pack CS6 which I had installed on a mac for one ye

    I really need help. I try to contact support to no avail. There simply is no option on the site, You are always referred to a further topic which has notihing to do with my problem. I bougnt a full master pack CS6 which I had installed on a mac for one year. Then, I decided to change it to another computer, so I sisintalled it according to instructions. In the meantime I got a free trial of creative cloud on that computer, but I gave up and decided to reinstall my cd-roms. However, everytime I try to use acrobat for instance it says that my trial period ran out! I disinstalled my cloud products, I am using my registered full master series items, they have nothing whatsoever to do with my creative cloud FREE subscription. If I try to cancel my free membership, it is to no avail, there simply is no such possiblity. I want to use the software I paid dearly for, not the cloud items I disinstalled and which do not interest me. How can I contact Adobe to fix it? It was no fault of mine, I did all I was supposed to, disintalling items before installing the right ones, but the system must have some error i am not responsible for.

    open an app and click help>activate.
    if you try to open an app and see a 'your trial has expired" window, click license this software and enter your serial number.
    if you can't do either, run the cleaner and make sure cc is cleaned from your computer, Use the CC Cleaner Tool to solve installation problems | CC, CS3-CS6

  • I need help installing windows 8.1 on my new laptop help me

    i need help installing windows 8.1 on my new laptop Hp Pavilion g7-2298nr help me it installs from store no problem then ask to restart then i restart it it gets stuck at windows logo and drive light on side not blinking i have shut down then it starts fine how to fix this problem so i can get it to install i need do it tonight reply before 8pm

    Hello,
    Thank you for posting in the HP Support Forum.
    Your computer comes with Win 8 pre-installed but one of the steps to install/run Windows 8.1 is having updated drivers for Windows 8.1
    Please, go to Control Panel -> System (or Start -> type winver and open) and verify what is your current version - if it is Windows 8 or 8.1
    Windows 8 is version  6.2.x
    Windows 8.1 is version  6.3.x
    If Windows 8 in place, then , please read this article and enroll in the steps:
    http://www8.hp.com/us/en/pdf/instruct_update_win8.​1_EN_tcm_245_1508074.pdf
    Update to the latest drivers prior and post installation respectively for win 8/8.1 :
    http://support.hp.com/us-en/product/HP-Pavilion-g7​-2200-Notebook-PC-series/5296086/model/5333384/dri​...
    Best wishes,
    IT_WinSec
    Hewlett-Packard employee | HP Enterprise Services
    Although I work for HP, I express my personal opinion.
    Visit www.hp.com/makeitmatter
    --Say "Thanks" by clicking the Kudos Thumb Up in the post that you find useful.
    --Please mark the post that solves your problem as "Accepted Solution"

  • I need help to reload my purchases to my new mac!

    I need help to reload my purchases to my new mac! My other mac harddisk died withou warning.
    When I log on to itunes store with my apple ID>purchased (new) i only get the lists for apps and books. Not music. Anybody know a different way to redownload my songs ??

    Currently music purchases can only be re-downloaded if you are in the US. If you aren't in the US then have you got a backup of your purchases on external drives and/or another computer ?

  • Need help re installing PS CS 6 on new windows 8 PC. have product key. HELP!! Please and thank you.

    Need help re installing PS CS 6 on new windows 8 PC. have product key. HELP!! Please and thank you.

    Downloadable installation files available:
    Suites and Programs:  CC 2014 | CC | CS6 | CS5.5 | CS5 | CS4, CS4 Web Standard | CS3
    Acrobat:  XI, X | 9,8 | 9 standard
    Premiere Elements:  13 | 12 | 11, 10 | 9, 8, 7 win | 8 mac | 7 mac
    Photoshop Elements:  13 |12 | 11, 10 | 9,8,7 win | 8 mac | 7 mac
    Lightroom:  5.7.1| 5 | 4 | 3
    Captivate:  8 | 7 | 6 | 5.5, 5
    Contribute:  CS5 | CS4, CS3
    Download and installation help for Adobe links
    Download and installation help for Prodesigntools links are listed on most linked pages.  They are critical; especially steps 1, 2 and 3.  If you click a link that does not have those steps listed, open a second window using the Lightroom 3 link to see those 'Important Instructions'.

  • Need help to restore my caller ID on new replaced sim card... iphone network won't switch feature on

    Need help to restore my caller ID on new replaced sim card... iphone network won't switch feature on

    cathorio wrote:
    I recently changed my lap top. My problem is the new lap top won't accept my apple I D it asked me to sing up for a new one which I did.
    I am puzzled by this. The laptop doesn't need the Apple ID - but iTunes does. I could be missing something but ....
    Why would you not be able to use your existing Apple ID and iTunes account on a new laptop? If you authorized the computer - you should be able to use your existing account - unless you already had 5 computers authorized with the existing ID - and that was why iTunes would not accept the ID. However, I'm sure that you would have received a popup message from iTunes telling you that you had reached the limit.
    I just received a new MBP and my daughter did as well. My entire family shares an Apple ID and we had no issues at all with my Apple ID and iTunes on our new computers and I did not have to sign up for a new account. Did you even try the old ID?

  • I need help whenever I want to install a new application I receive a message that I cannot be connected to I tunes store although I am connected to the Internet Help

    I need help whenever I want to install a new application I receive a message that I cannot be connected to I tunes store although I am connected to the Internet Help

    Click here and follow the instructions to change the iTunes Store country.
    (85848)

  • I need help finding a power supply

    I need to find a power supply that is compatible with my Compaq  Presario SR5816F
    It needs to have a minimum  output of 12v @ 18 amps    and  have at leaast 350 wattts...
    thanks.
    This question was solved.
    View Solution.

    See my reply to your later thread:
    http://h30434.www3.hp.com/t5/Desktop-Hardware/Will-this-power-supply-work-with-my-PC/m-p/4292292#M85...
    Signature:
    HP TouchPad - 1.2 GHz; 1 GB memory; 32 GB storage; WebOS/CyanogenMod 11(Kit Kat)
    HP 10 Plus; Android-Kit Kat; 1.0 GHz Allwinner A31 ARM Cortex A7 Quad Core Processor ; 2GB RAM Memory Long: 2 GB DDR3L SDRAM (1600MHz); 16GB disable eMMC 16GB v4.51
    HP Omen; i7-4710QH; 8 GB memory; 256 GB San Disk SSD; Win 8.1
    HP Photosmart 7520 AIO
    ++++++++++++++++++
    **Click the Thumbs Up+ to say 'Thanks' and the 'Accept as Solution' if I have solved your problem.**
    Intelligence is God given; Wisdom is the sum of our mistakes!
    I am not an HP employee.

  • Need help hp 520 power on password ican' break it

    pls help hp 520 power on password i try reset in bios still on power on password

    pls help hp 520 power on password i try reset in bios still on power on password

  • Need HELP with setting up my email on new 4g ipod touch.

    I need help setting up my email on my 4g ipod touch. I just got it today and had a 1st gen and it worked fine. I need help setting it up again.
    Any help would be appreciated
    Thanks in advance.
    Pam

    http://www.apple.com/support/ipodtouch/assistant/sendmail/

  • HT1338 hello! I need help, how come I can't receive new messages on my mail in my Macbook Pro? but I can receive it on my Iphone4s. thanx!

    hi there! can somebody please help me. I can't receive new messages in my MacBook Pro, what should I do? I can read them in my IPhone though. Thanx!

    Yes I was able to send but not receive - I actually was able to solve it myself
    Everything on the menu bar was greyed out - so nothing there helped me @ all
    Connection Doctor didn't show anything wrong
    activity box was completely blank
    shutdown - restart didn't work
    I used the help option    - still nothing
    All the while my phone was vibrating like crazy with new emails
    It was really frustrating & it seemed apple themselves don't have any real solutions to offer
    My instincts told me to delete the email completely - so I did
    After a few min I added the email account like a new one and it eventually worked - all my new emails were there, I still don't know why it stopped in the 1st place  
    Pretty much all the problems I run into I troubleshoot myself and find the solution

  • Need help in configuring Cisco AP to support EAP authentication

    Hello all,
    in desperation after trying for more than 3 weeks, I am trying in this way to get a solution to my following problem.
    I am trying to build up as 802.1x scenario using 802.11b infrastructure (RADIUS server, Cisco 1100 Aironet AP, Cisco PCMCIA WLAN card with Xsupplicant software, the complete OS is Linux). I am trying to use EAP-MD5 authentication. It seems that the things are funtioning in standalone mode.
    The client wants to authenticate to access WLAN. It sends EAPoL start packet and gets a request from AP for user identity. Good. Then the user sends his identity with EAP packet. The Cisco AP is forwarding the request to RDAIUS server as specified in many documents. It is also Good. RADIUS server is sending a request for challenge (Password). Upto this point things are gooing fine.
    Now the Cisco AP is not sending this challenge to the
    Xsupplicant, it is just ignoring it. Can any one help me in this point. If needed I can also send the configuration file of the AP.
    I would be very thankful, if I could solve this Problem with your support.
    Thanking you in advance,
    Felix

    As per the RFC for RADIUS, a RADIUS Server receiving an Access-Request with a Message- Authenticator Attribute present MUST calculate the correct value of the Message-Authenticator and silently discard the packet if it does not match the value sent. A RADIUS Client receiving an Access-Accept, Access-Reject or Access-Challenge with a Message-Authenticator Attribute present MUST calculate the correct value of the Message-Authenticator and silently discard the packet if it does not match the value sent.

  • Need help w/ G4 Power Mac PLEASE!

    I bought a used & ancient I know Mac for my kids to use for school project ect. It is a G4 Power Mac. It came w/ all the originial cd's. The guy told me they had been using it mainly his kids as well but he took everything off it & cleaned it to original. I am trying to reinstall the software. When I put the 1st disc in & I followed the instructions of restarting the computer & holding down the C key. It gets to this blue screen that looks like a little man holding a sword all over it & nothing comes up. Any help appreciated! THANKS!

    Hello,
    Could it be a spinning gray radian?
    http://support.apple.com/kb/TS2570
    Hold the Option/alt key at powerup, what choices does it show for a boot source?

  • HT3096 Someone please help, I'm a broke a$$ college student who needs help with a power Mac G5

    Im considering buying a power mac G5 but only cuz its all i can afford and i got an idea about hooking ut up to my tv but i would want to be able to use a wireless keyboard and traction pad but i did some reserch online and found out i need a airport extreme with 2.0  EDR to enable bluetooth which is a requirement for the wireless keyboard. Where can I find the AirPort Extreme with Bluetooth 2.0+EDR card? There dosent seem to be any place online that sells it and lets say I do install the airport extreme card and enable wifi on a power Mac G5, will I be able to use a apple wireless keyboard with it? And just a side question, for the age of the computer what OS should I have installed, I'm not to femilliar with apple software, the only apple products I have are old iPods n a 4s. Oh and I would mainly use it for going online, a little bit of vid editing, watching YouTube vids, homework and uploading and listing to music, I would love to wirelessly sync my iPhone to the power Mac wirelessly.

    Forgot Your Account Password
    For Lion, Mountain Lion, or Mavericks
        Boot to the Recovery HD:
    Restart the computer and after the chime press and hold down the COMMAND and R keys until the menu screen appears. Alternatively, restart the computer and after the chime press and hold down the OPTION key until the boot manager screen appears. Select the Recovery HD and click on the downward pointing arrow button.
         When the menubar appears select Terminal from the Utilities menu.
         Enter resetpassword at the prompt and press RETURN. Follow
         instructions in the dialog window that will appear.
         Or see:
           Reset a Mac OS X 10.7 Lion Password
           OS X Mountain Lion- Reset a login password,
           OS X Mavericks- Solve password problems,
           OS X Lion- Apple ID can be used to reset your user account password.
    For Snow Leopard and earlier with installer DVD
         Mac OS X 10.6- If you forget your administrator password,
         OS X- Changing or resetting an account password (Snow Leopard and earlier).
    For Snow Leopard and earlier without installer DVD
        How to reset your Mac OS X password without an installer disc | MacYourself
        Reset OS X Password Without an OS X CD — Tech News and Analysis
        How To Create A New Administrator Account - Hack Mac

  • Need help in triggering the Data stream load  using process chain

    Hi Guru's
    is it possible to trigger a data stream load using process chain?
    Any help is highly appreciated.
    Thanks
    Indiran

    Hi Indiran and welcome aboard!
    Don't think this is possible. SAP BW & SAP SEM-BCS are rather independent systems. Though, BCS lives on top of BI-BW stack, it even may have master data different from those in BW.
    Process chains, AFAIK, is completely the BW's feature. Certainly, you may use PCc on BW side, loading ODS/DSO and cubes involved in BCS data model.
    The main con here is the lost transparency -- you don't control everything from the consolidation monitor.
    The pro side is also rather obvious for me. Since, very often there is a huge difference between data quality at the data source and in the BCS totals cube, I need to make a lot of data transformation. Not only some data calculations or cleaning, but also transformation of data model: key figure model -> account model. It's much more easier to do in BW, for me.
    I even call the ODS/cubes/routines involved in such transformation as intermediate layer, the layer between data source and SEM-BCS.
    And this layer lives rather independently from BCS.
    Hope this helps.

Maybe you are looking for