Database optimisation ressource (for expert only :) )

Hi
Juste a (big) question,
we want to migrate our application from (linux code-grep, cut, wc.....cammande) to JAVA or PRO C
the application takes on input flat files (4 flate file per minutes) each file containes 100.000 lines to reformate with grep command and then load them into a partitionned database 10g
what do you suggeste me you experts to implement for the best use of my database
solution 1 : the use of java code rather then linux code
solution 2 : the use of C /pro C code rather then linux code and java code
solution 3 : the use of external tables in oracle (consider my flat files as external table) and contain do all the trasformation with native SQL code rather then linux code and java code and C code
I realy need your help,
we don't want to use teradata cause of the expencive price, and we ask me to make optimum developpement
Tks in advance

If pressed, I would probably go for option 3.
Te "optimum" you want is dependent on the needs and objectives of your organization, so I cannot answer what is best for you.
What's wrong with grep, sed and awk?
Yours,
Laurenz Albe

Similar Messages

  • FOR EXPERTS ONLY !       JPA provider internals

    Is there any way by using a JPA provider like Toplink essentials, to use (explicitly, ir implicitly) stored procedures ?
    Is JPA capable of handling "ULTRA-MEGA-GIGA-large-scale-application" with ultra strong performance requirements ?
    How much is the overhead of using a JPA provider over a low level interface ?
    What is a basic architecture of a JPA provider ?

    Is there any way by using a JPA provider like Toplink essentials, to use (explicitly, ir implicitly) stored procedures ?Yes, but not TopLink Essentials, either TopLink 11g or EclipseLink.
    Is JPA capable of handling "ULTRA-MEGA-GIGA-large-scale-application" with ultra strong performance requirements ?Sure.
    How much is the overhead of using a JPA provider over a low level interface ?Depends on how optimized your JPA and JDBC implementation is, and your application. JPA like JDBC can have poor performance if you do things the wrong way. Most JPA providers allow easy configuration of advanced JDBC optimizations, so make optimizing performance much easier. Most JPA providers also provide performance features such as caching, which most raw JDBC code does not take advantage of. Obviously JPA works on top of JDBC, so in an ideal implementation of both (ignoring caching) JPA would have an overhead, 10% is typically a good guess.
    What is a basic architecture of a JPA provider ?See,
    [http://wiki.eclipse.org/EclipseLink/Development/Architecture|http://wiki.eclipse.org/EclipseLink/Development/Architecture]
    James - [http://www.eclipselink.org]

  • Database open for read-only access ORACLE

    while building a universe with a dblink betweens oracle databases, i try to create a derived table in the form
    select field1 from table@db_to_db2
    but i get the following message:
    Exception: DBD, ORA-16000: database open for read-only acces State N/A.
    I understand the statement "Set Transaction for read only"  must be set before any transaction during the session, but still dont know how to trigger it in bo universe designer.
    Can someone know how to solve it?

    I suggest you fill-in the BEGIN_SQL parameter on the Universe to turn on the read-only transaction.
    Here is an excerpt from the Universe Designer guide:
    The BEGIN_SQL parameter allows you to prefix SQL statements with the same parameters each time a SQL statement is generated.
    1. Open the "Universe Parameters" dialog box in Designer.
    2. Click the Parameter tab.
    3. In the "Parameter" list, select the BEGIN_SQL parameter and enter the
    appropriate prefix commands.
    4. Save the settings.
    5. Save the universe.

  • How to show a database to a user for which only he has the read access?

    Hi All,
    We have a SQL Server and it has say 10 datatabases, we have created a login and also a user which has read access to just one of the 10 databases.
    I used 
    use [master]
    DENY VIEW ANY  DATABASE to msam_test
    To hide all the databases from explorer for that user if he logsin with msam_test.Now, i want this user to see a database named suresh3_test for which he has a read access.
    Can someone please help me if this is achievable?
    Thanks

    hi,
    It is not possible to look at one database if the user only have read access in your scenario.
    either you revoke the DENY VIEW ANY  DATABASE permission, which will list all the databases  for the user
    or  You need to make the user database owner by doing so:
    First delete the user from the database
    Right click on the database and select properties and change the owner to msam_test as shown in the pic below
    But the user will have owner rights on the database.
    Hope this clarifies your doubt. The same was explained in your earlier post as well
    Thanks
    Bhanu

  • Check "Problem: Oracle Database 10g Release 2 can only be installed in new

    Hi All
    Installing 10g software on AIX Box in /oracle/oraHome2,where oracle9i is already installed in /oracle/oraHome1 and oracle inventory is in /oracle/inventory
    In product specific prerequisite screen I am getting the
    check:Oracle Home incompatibilties is failed I am getting the error
    Check complete. The overall result of this check is: Passed
    =======================================================================
    Checking for Oracle Home incompatibilities ....
    Actual Result: Oracle9i Database 9.2.0.1.0
    Check complete. The overall result of this check is: Failed <<<<
    Problem: Oracle Database 10g Release 2 can only be installed in a new Oracle Home
    Recommendation: Choose a new Oracle Home for installing this product
    though I am installing it in different oracle homes why i am getting this error?
    Is it because 10g installation is picking the same oracle inventory /oracle/inventory
    do i need to make different oracle inventory for different oracle homes???????plz confirm..is thats the reason i am getting this error??????
    Thanks inadvance
    Gagan

    I figure out you are trying to install 10gR2 on top of an existing 9iR2 Oracle Home. This is corrected at the Path definition window. Most probably you just click on the <Next> and by default the 9iR2 Oracle Home was selected. You must define a new oracle home for the 10gR2 install.
    ~ Madrid

  • Can't apply AP credit for freight only

    It is sometimes necessary to enter an A/P Credit Memo for freight only.  This has been doen by entering a service-type credit memo, with nothing in the rows but an amount in the Freight section of the footer.  Then this credit memo can be selected along with one or more invoices when creating an outgoing payment.  This procedure has worked without any problms in version 2007.
    Now the customer is upgrading to 8.81 PL8.  When the scenario above is followed, there is an error on the outgoing payment which says "No Record Matching" and references RPC1, the A/P Credit Memo rows.  If I populate a row on the credit memo with any GL account and a zero amount, there is no error.  We have tested at 8.81 PL9 and also 8.82 PL0, and the error also comes up in those versions.
    Is this a bug in the system?  There doesn't seem to be any reason why the credit memo should not be accepted in the outgoing payment, regardless of whether it has anything in the rows or not. 
    Thanks for your help.
    Marcia

    Thank you both for your replies. 
    I have checked this issue in several different databases, including the SAP demo, in the different versions referenced above.  The results are consistent: there is no error in versions prior to 8.81 PL8, and there is an error from PL8 onward.

  • "In-Memory Database Cache" option for Oracle 10g Enterprise Edition

    Hi,
    In one of our applications, we are using TimesTen 5.1.24 and Oracle 9i
    databases (platform - Solaris 9i).
    TimesTen holds application information which needs to be accessed quickly
    and Oracle 9i is a master application database.
    Now we are looking at an option of migrating from Oracle 9i to Oracle 10g
    database. While exploring about Oracle 10g features, came to know about
    "In-Memory Database Cache" option for Oracle Enterprise Edition. This made
    me to think about using Oracle 10g Enterprise Edition with "In-Memory
    Database Cache" option for our application.
    Following are the advantages that I could visualize by adopting the
    above-mentioned approach:
    1. Data reconciliation between Oracle and TimesTen is not required (i.e.
    data can be maintained only in Oracle tables and for caching "In-Memory
    Database Cache" can be used)
    2. Data maintenance is easy and gives one view access to data
    I have following queries regarding the above-mentioned solution:
    1. What is the difference between "TimesTen In-Memory Database" and
    "In-Memory Database Cache" in terms of features and licensing model?
    2. Is "In-Memory Database Cache" option integrated with Oracle 10g
    installable or a separate installable (i.e. TimesTen installable with only
    cache feature)?
    3. Is "In-Memory Database Cache" option same as that of "TimesTen Cache
    Connect to Oracle" option in TimesTen In-Memory Database?
    4. After integrating "In-Memory Database Cache" option with Oracle 10g, data
    access will happen only through Oracle sqlplus or OCI calls. Am I right here
    in making this statement?
    5. Is it possible to cache the result set of a join query in "In-Memory
    Database Cache"?
    In "Options and Packs" chapter in Oracle documentation
    (http://download.oracle.com/docs/cd/B19306_01/license.102/b14199/options.htm
    #CIHJJBGA), I encountered the following statement:
    "For the purposes of licensing Oracle In-Memory Database Cache, only the
    processors on which the TimesTen In-Memory Database component of the
    In-Memory Database Cache software is installed and/or running are counted
    for the purpose of determining the number of licenses required."
    We have servers with the following configuration. Is there a way to get the
    count of processors on which the Cache software could be installed and/or
    running? Please assist.
    Production box with 12 core 2 duo processors (24 cores)
    Pre-production box with 8 core 2 duo processors (16 cores)
    Development and test box with 2 single chip processors
    Development and test box with 4 single chip processors
    Development and test box with 6 single chip processors
    Thanks & Regards,
    Vijay

    Hi Vijay,
    regarding your questions:
    1. What is the difference between "TimesTen In-Memory Database" and
    "In-Memory Database Cache" in terms of features and licensing model?
    ==> Product has just been renamed and integrated better with the Oracle database - Times-Ten == In-Memory-Cache-Database
    2. Is "In-Memory Database Cache" option integrated with Oracle 10g
    installable or a separate installable (i.e. TimesTen installable with only
    cache feature)?
    ==> Seperate Installation
    3. Is "In-Memory Database Cache" option same as that of "TimesTen Cache
    Connect to Oracle" option in TimesTen In-Memory Database?
    ==> Please have a look here: http://www.oracle.com/technology/products/timesten/quickstart/cc_qs_index.html
    This explains the differences.
    4. After integrating "In-Memory Database Cache" option with Oracle 10g, data
    access will happen only through Oracle sqlplus or OCI calls. Am I right here
    in making this statement?
    ==> Please see above mentioned papers
    5. Is it possible to cache the result set of a join query in "In-Memory
    Database Cache"?
    ==> Again ... ;-)
    Kind regards
    Mike

  • Best practice for read-only functionality

    Hi,
    I'm part of the development team of a system with about 100 screens. The customer would like us to add some read-only functionality to the system, so that certain users are able to access the screens but not change any of the data on them. We already have policies in place on the database level that keeps read-only users from saving data, but it's not very user friendly to allow users to change data on a screen, only to tell them that they're not allowed to save those changes once they try to do so. It would clearly be better if all components are rendered as read-only components for read-only users, making them unable to make any data changes in the first place.
    User privileges in the system are controlled by roles defined and set in the system (not ADF roles or Weblogic roles). At any given time and place, it's possible to check whether the current user has a certain role. We already use this in a number of places to make it possible to control which user has access to which screens. In a few places we even control which functionality should be enabled for the current user within a screen, but mostly the access control is currently on the screen level. With read-only users getting access to all screens, it seems we will need lot of extra in-screen access control to keep these users from changing anything.
    But what's the best practice here? One way to go would be to add some logic to every single active component on every single screen, to determine whether it should be rendered as active or disabled/read-only. But that would require a lot of extra coding.
    So my question is: Is there a smarter way to do this? Maybe something done through skinning? Or something else?
    (I'm not sure how relevant this is for this sort of question, but we're currently using JDev 11.1.1.4.0, and expect to upgrade to 11.1.1.6.0 within the next 6 months)
    Best regards,
    Andreas

    Hi Guna, Puthanampatti and Don,
    Thanks a lot for your replies. I'm currently looking into implementing something along the lines of what Guna has suggested:
    Our application consists of a number of individual work spaces that are deployed as adflibs which have all been added to a "master application work space", and the master application is deployed as an .ear file. Most of the individual work spaces are for all the different functional areas of the application, with their own task flows, page fragments etc. The rest are work spaces with common functionality, like datamodel (entity definitions), utility methods, page templates, and framework extensions. In the latter, we have defined custom classes for all the base classes (somewhat similar to what Don describes, I believe).
    In our custom class for ViewRowImpl, I have added an isAttributeUpdateable method, and in our custom class for ApplicationModuleImpl I have added an isReadOnlyUser method. The isAttributeUpdateable method uses the isReadOnlyUser method to determine if the current user is a read-only user or not; if the user is a read-only user the isAttributeUpdateable method will return false, otherwise true. The isReadOnlyUser method in our base class is just a dummy method that always returns true. But in the ApplicationModuleImpl classes of our individual work spaces, i've written an override for isReadOnlyUser, giving the answer that is relevant for the work space in question (for instance, whether or not the current user has the role "User Administrator").
    That pretty much takes care of all input fields in tables and forms, which is a big step in the right direction. This still leaves some work to be done for components that are not directly linked to view object attributes (like buttons), but I guess that can't be helped. Also, there are a few of the work spaces that contain a number of pages that are related to different user privileges (as in: page 1 requires user privilege A, and page 2 requires user privilege B); in these cases I will have to do something different than just writing an override in the "local" ApplicationModuleImpl class.
    @Don: What you describe seems to be pretty close in functionality to what we already have, though your implementation is different from ours. You have used your custom base ApplicationModuleImpl class to keep read-only users from committing changes. We use Virtual Private Database and database policies to the same end: If a user without the required full-access role tries to commit data it will cause a database error, which we then handle in the application (so the user gets a message like "You don't have the required privileges to changes this data", rather than an ORA message). Unfortunately, our customers are not content with this. They want a solution where all input fields and most of the buttons etc. are disabled for read-only users, and that's why I'm looking into the best/smartest way to do this.
    @Puthanampatti: We already use something similar to what you're suggesting. The challenge I'm currently facing is how best to disable/enable components based on the current user's roles, not how to determine and store those roles.
    Best regards,
    Andreas

  • Unable to find Database Item Name for Employee Category at assignment level

    Hi,
    What is the database item name for employee category at assignment level.
    I want to call employee category colomn of assignment level in fast formula.
    Thanks in advance...

    It seems that there are no seeded database items available for employee category, the only other option is to write a plsql function at the database level which will return the employee category for a given assignment_id & effective dates. Link this plsql function to a Fast formula function. You can use the newly created fast formula function in your fast formula.
    Regards,
    Senthil

  • The database logon information for this report is either incomplete

    Hello All
    I have installed a full licensed version of crystal reports server 2008 onto a windows server 2003 virtual server.
    I am getting the following error message when trying to run some reports when i am logged in as the adminstrator
    'The database logon information for this report is either incomplete or incorrect.'
    Some reports work and some dont, I use the same login information for all reports, same username and same password, same machine datasource and all the reports  run fine in crystal designer 2008
    The only difference i can see is that the error mainly occurs with reports that use stored procedures, the ones that dont work fine.
    I not sure how to resolve this problem as i have tested the login and the datasoure and it works fine, just not through crystal reports server

    Further to this i've realized that this only happens with reports which have been updated to use a stored procedure from a query file. And the reports dont use any repository objects

  • Data for weekedays only

    Dear All,
    I have Production environment I want to write a SQL query which should only return rows in database for weekdays only. There is one column in the table which contains transaction date. Is it possible if we skip weekend transaction for example on Saturday and Sunday or in Middle East weekend Friday and Saturday.
    Need help please..............
    Regards,

    The to_CHAR format D or DAY will work for you.
    SUNDAY is 1, MONDAY is 2 and so on.
    sudhakar@ORCL>ed
    Wrote file afiedt.buf
      1  with sampledata as
      2  (
      3  select (sysdate-level) sdt from dual connect by level < 16
      4  )
      5  select sdt,
      6  to_char(sdt,'DAY') dayn, to_char(sdt,'D') dsy1
      7* from sampledata
    sudhakar@ORCL>/
    SDT       DAYN      D
    22-MAY-10 SATURDAY  7
    21-MAY-10 FRIDAY    6
    20-MAY-10 THURSDAY  5
    19-MAY-10 WEDNESDAY 4
    18-MAY-10 TUESDAY   3
    17-MAY-10 MONDAY    2
    16-MAY-10 SUNDAY    1
    15-MAY-10 SATURDAY  7
    14-MAY-10 FRIDAY    6
    13-MAY-10 THURSDAY  5
    12-MAY-10 WEDNESDAY 4
    11-MAY-10 TUESDAY   3
    10-MAY-10 MONDAY    2
    09-MAY-10 SUNDAY    1
    08-MAY-10 SATURDAY  7
    15 rows selected.
    sudhakar@ORCL>vr,
    Sudhakar B.

  • How to Block mails for HR only

    Dear   expert/guru
        Please let me know how to block mails for HR only.
       We don't want to block  mails for all.....

    Juan Reyes wrote:
    There is no way to block mails based on a "Module", as Olivier said you can only filter mails per domain under the node config in SCOT.
    >
    > I don't understand why would anyone see a benefit by stopping people on an specific are from receiving mail. In anycase you can stop the SAPCONNECT job and filter the mails to be sent manually from SOST but thats a lot of work!.
    >
    > Regards
    > Juan
    >
    > PS: Also you can simply stop the jobs creating the "HR mails" in the first place.... huh?
    hi,
    Issue is given below:
    My SAP HR Team has some leave issues.
    Due to which they need to stop the triggering of mails for few mins in Production system

  • I require a TIMS database add in for office 2013

    The add in for that was available for Office 2010 and 2007 edition. I am on a 2013 office edition. I cant seem to find the add in version for 2013. Is there a work around for that?

    Hi UDIT,
    From the description, you want to find a TIMS database add-in for Office 2013 and the add-in only available for Office 2007 and Office 2010 edition.
    I suggest that you contact the vendor of this add-in to see whether there is a new version works for Office 2013.
    Best regards
    Fei
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • 1z0-054: Oracle Database 11g Performance Tuning Expert

    I am planning to give the exam 1z0-054 to get the certification, "Oracle Database 11g Performance Tuning Expert".
    The Certification Path says that, if you are and "OCP DBA 11g" then you can directly take this paper, and there is no Instructor Led Training requirement. Therefore, I decide to prepare for it by my own. Can someone guide me about the study material and dumps?
    Regards,
    Ahmer Mansoor

    Therefore, I decide to prepare for it by my own. Can someone guide me about the study material and dumps?First of all, the word 'dumps' has a specific meaning. It is shorthand for 'brain dumps' which are illegal and can cost you this certification and any others you have taken.
    http://blogs.oracle.com/certification/entry/0477
    Second -- there currently is no study guide or book specific to this certification available at this time. I write study guides and this one is actually next on my list once I complete the current book for *1Z0-117: Oracle Database 11g Release 2: SQL Tuning*. I won't have a guide for 1Z0-054 until some time in May most likely. That said, I have some links to legal study material on the companion website for my guide series relevant to topics for this exam. It also has links to the Oracle documentation that contains information you need. Once I start writing the book for this exam, the links will expand rapidly as I research the topics for it and the documentation links may expand as well.
    http://www.oraclecertificationprep.com/apex/f?p=OCPSG:EXAM_DETAILS:0::NO::P2_EXAM:1Z0-054

  • Where can I get Oracle database server 9i for windows 2003

    Hi,
    I need Oracle Database Server 9i for Windows 2003. From Oracle online download, there is one a patch set available. Where can I get the full version?
    Thanks
    Laura

    Hi, I found the solution. There is no software to direcly install Oracle 9i on Windows 2003. I need to install the software for NT/2000 first, the patch it.
    That's why there is only patchset for 2003 for downloading. See the doc below:
    three installation components required to install
    Oracle9i Database release 2 (9.2.0.3.0) on Windows Server 2003. These three
    installation components must be installed in the order listed. If you are
    migrating a pre-existing Oracle9i database to Windows Server 2003, first
    upgrade the database to the Oracle9i Database release 2 (9.2.0.3.0) patch set
    before upgrading the operating system.
    Obtain the following installation components:
    Oracle9i Database Release 2 (9.2.0.1.0) for Windows
    Oracle Universal Installer release 2.2.0.18.0 for Windows
    Oracle9i Database Release 2 (9.2.0.3.0) Patch Set for Windows

Maybe you are looking for