Multithreaded write support in Master

1. We have an design where in we write synchronously at the master level. Since it is
bottleneck to usesynchronous write in a multithreaded environment. We have removed the
synchronous write,
which lead to too many DB_LOCK_NOTGRANTED Exception at master.
Note: write transaction timeout = 10secs ( which is too high)
Below PseudoCode will help in understanding above point.
HttpController
requestHandler()
     synchronous
     adapter.write(entity);
     //the adapter writes data to master inside a transaction with timeout value
10secs.
The questions are
a) Does BDB support multithreaded write at master?
b) If yes, is it something configurable?
2. In our new design, we have created an asynchronous threads(3 threads with queuecapacity of
20k) at the master level. 8-13 Replica(In production will have asynchronous threads(3 threads
with queuecapacity of 200k). What is the optimum number of threads that we can have at the
master level and queueCapacity?
For eg.
HttpController
requestHandler()
     aynchronousthreadexecutor.execute(entity, adapter);
     //asynchronous thread with 3 threads, 20k queueCapacity     
}

Corrigendum: Added information about BDB Version and few more helping information for this context.
Hi There,
We have the following questions w.r.t Multi threaded write at master.
1. We have an design where in we write synchronously at the master level. Since it is bottleneck to
use synchronous write in a multithreaded environment we have removed the synchronous write,
which lead to too many DB_LOCK_NOTGRANTED Exception at master.
Note: write transaction timeout = 10secs ( which is too high)
Below PseudoCode will help in understanding above point.
HttpController
requestHandler()
     synchronous
     adapter.write(entity);
     //the adapter writes data to master inside a transaction with timeout value 10secs.
The questions are
a) Does BDB support multithreaded write at master?
b) If yes, is it something configurable?
2. In our new design, we have created asynchronous threads(3 number with queuecapacity of 20k) at the
master level. Replica will have asynchronous threads(3 number with queuecapacity of 200k). In Production Replica count could
go upto 13.
a) What is the optimum number of threads that we can have at the master level
b) What would be ideal value qeueCapacity for the Executor (we use Spring Thread Executor)?
For eg.
HttpController
requestHandler()
     aynchronousthreadexecutor.execute(entity, adapter);
     //asynchronous thread with 3 threads, 20k queueCapacity     
Thanks.

Similar Messages

  • Enabling (native) write support for NTFS

    I used NTFS-3G for writing on NTFS before, but because of this (https://discussions.apple.com/thread/4187322) i had to uninstall it.
    A while ago i heard something about OSX having native write support for NTFS.
    Is that even true? And if so, can i (and how) enable it on Mountain Lion?

    Tbassist4 wrote:
    Thank you. I've been looking at these two a little bit. NTFS-3g seemed like a pretty good choice at first, but I question the stability a little bit, as they do warn you that the project is experimental. Paragon actually looks like a good, safe solution, and also generally inexpensive, but I am trying to find out whether or not it will run on intel-based Macs, as it only lists system specs for running the program on a PPC-based Mac. I'll report the results as soon as I find out.
    On the System Requirements Page for Paragon it does say Intel. Actually it says x86 which are Intel processor architecture, plus on the box it shows the Universal logo on it (hard to see but it's there).
    David L.

  • How to enable the NTFS Read/Write support without 3rd party software?

    Is there a way to enable the NTFS Read/Write support of Mac OS X 10.6.8?

    Well, I've used Paragon NTFS, but if you don't want to use 3rd party software, you should do this AT YOUR OWN RISK:
    Open Terminal.app (/Applications/Utilities/Terminal)
    Type "diskutil info /Volumes/volume_name" and copy the Volume UUID (bunch of numbers).
    Backup /etc/fstab if you have it, shouldn't be there in a default install.
    Type "sudo nano /etc/fstab".
    Type in "UUID=paste_the_uuid_here none ntfs rw" or "LABEL=volume_name none ntfs rw" (if you don't have UUID for the disk).
    Repeat for other NTFS partitions.
    Save the file (ctrl-x then y) and restart your system.
    After reboot, NTFS partitions should natively have read and write support. This works in both 32 and 64-bit kernels. Support is quite good and fast, it even recognizes file attributes such as hidden files.
    Good luck!

  • BDB Native Version 5.0.21 - asynchronous write at the master node

    Hi There,
    As part of performance tuning, we think of introducing asynchronous write capabilities at the master node in replication code that uses BDB native edition (11g).
    Are there any known issues with the asynchronous write at the master node? We'd like to confirm with Oracle before we promote to production.
    For asynchronous write at the master node we have configured a TaskExecutor with the following configuration:
    <bean id="MasterAsynchronousWriteTaskExecutor" class="org.springframework.scheduling.concurrent.ThreadPoolTaskExecutor">
    <property name="corePoolSize" value="3"/>
    <property name="maxPoolSize" value="10"/>
    <property name="daemon" value="true"/>
    <property name="queueCapacity" value="200000"/>
    <property name="threadNamePrefix" value="Master_Entity_Writer_Thread"/>
    <property name="threadGroupName" value="BDBMasterWriterThreads"/>
    </bean>
    Local test showed no issues. Please let us know at the EARLIEST convenience if there are any changes required to corePoolSize, “maxPoolSize” and “queueCapacity” values as a result of asynchronous write.
    To summarize, 2 questions:
    1) Are there any known issues with the asynchronous write at the master node for BDB Native, version 5.0.21?
    2) If there are no issues, are any changes required to corePoolSize, “maxPoolSize” and “queueCapacity” values as a result of asynchronous write, and based on the configuration above?
    Thank you!

    Hello,
    If you have not already, please take a look at the documentation
    on "Database and log file archival" at:
    http://download.oracle.com/docs/cd/E17076_02/html/programmer_reference/transapp_archival.html
    Are you periodically creating backups of your database files?
    These snapshots are either a standard backup, which creates a
    consistent picture of the databases as of a single instant in
    time; or an on-line backup (also known as a hot backup), which
    creates a consistent picture of the databases as of an
    unspecified instant during the period of time when the
    snapshot was made. After backing up the database files you
    should periodically archive the log files being created in the
    environment. And I believe the question here is how often
    the periodic archive should take place to establish the
    best protocol for catastrophic recovery in the case of a
    failure like physical hardware being destroyed, etc.
    As the documentation describes, it is often helpful to think
    of database archival in terms of full and incremental filesystem
    backups. A snapshot is a full backup, whereas the periodic
    archival of the current log files is an incremental backup.
    For example, it might be reasonable to take a full snapshot
    of a database environment weekly or monthly, and archive
    additional log files daily. Using both the snapshot and the
    log files, a catastrophic crash at any time can be recovered
    to the time of the most recent log archival; a time long after
    the original snapshot.
    What other details can you provide about how how much activity
    there is on your system with regards to log file creation
    and how often a full backup is being taken, etc.
    Thank,
    Sandra

  • Over write the existing master data with new master data.

    hi friends,
    we have 2 sources for master data text like source A and source B to load the master data text and as per requirement we have to stop load from source A. But if you check the master data target still the old records are existed (from Source A), if i try to delete those records as you know it is not allowing...and more over if we want to delet the mastr data we have delete the transaction data.
    In Mycase i don't want to delet the Transaction data and i need to over write the existing master data i.e Request A with Rquest B.
    Is there any solution for this issue.
    Thanks in advance,
    Sruthi.

    For overwriting the text from source B you have to have transformations from source B to your text datasource of your characteristic. Then you map the text coming from source B to the text for the characteristic.
    If it comes form source B the key for that characteristic with text, it will overwrite the text existed for that characteristic to the same key.
    For example you have 0employee and have a text datasource in source A which has employee_id and employee_name. In the Bw you have mapped in your transfer rules the employee_id to the employee_id and the employee_name to the employee_name. So for example you have extracted from source A the record:
    employee_id   employee_name
    0001               xpto
    If you have a same datasource of text coming from source B, if you do the same mapping in transfer rules in BW coming from source B, and you bring for example the record:
    employee_id   employee_name
    0001               zzzz
    You'll overwrite the old value of xpto to the new value zzzz
    Diogo.

  • Does third party external dvd writer support mac air?

    i want to purchase an external dvd writer for my mac air MC956. does third party dvd writer support mac air?

    usb dvd writers would work the same on all osx computers so if
    macbook pro or normal macbook or imac are supported air will work too

  • Does OSX Lion have native ntfs read/write support?

    Does OSX Lion have native ntfs read/write support?

    There's no way to undo a solved answer...
    Mistral73 wrote:
    Thanks for your reply maigpl2.
    Sorry guys I clicked on "Correct Answer" by mistake. Could someone please tell me how to undo that?
    Many thanks

  • Satellite A200-10Z: How to know if my DVD writer support Labelflash

    Hi,
    I have Toshiba Satellite A200-10Z that came with supermulti DVD writer model HL-DT-ST DVDRAM GSA-T20N, I don't know from which manufacturer this model!!
    Does anyone know if this model support Labelflash?! ?:|

    Googling around I found info that this drive must be from Hitachi. Unfortunately I didnt find any info about Labelflash.

  • Fast Writes Supported But Disabled

    I've got a KT4 Ultra (without FISR) and a Radeon 9000 (without Pro).
    I've got FastWrites enabled in my BIOS, but every program I use says that it is disabled.
    I've tried some drivers and it's all the same.
    I've also tried to enable it with smartgart and some tweak programs, but every time I reboot, it is disabled.
    (I have to reboot every time I enable this if I want changes to take effect)
    Why does it happen?
    Do I have to flash my BIOS  8o ?
    It's all another KT4 problem?
    Maybe it's a Radeon 9000 problem?
    By the way, I have the VIA 4.43 Drivers and the Radeon 6166 and 6193 drivers for XP.
    Sorry for my english.

    Hi,
    Have you tried with PowerStrip?
    Enabling AGP Fast Write is done by the display card itself. The BIOS actually "facilitates" the display card if it supports this feature.
    You might want to contact your Radeon 9000 manufacturer to confirm on this.

  • Are companion ads not supported for MAST?

    Hi again.
    I added companion ads in vast source:
    <CompanionAds>
        <Companion>
            <AltText><![CDATA[Alt Text for Companion]]></AltText>
            <CompanionClickThrough>
                <URL><![CDATA[http://google.com]]></URL>
            </CompanionClickThrough>
        </Companion>
    </CompanionAds>
    And SMP hangs up.
    My vast source file is similar to this.
    When CompanionAds tag is empty SMP works properly.
    What's the reason?

    I tried to trace the issue and found that:
    in plugins/samples/MASTPluginNew/org/osmf/mast/loader/MASTDocumentProcessor.as (from osmf_1-5_fc_source)
    I get a loadError in loadVastDocument() after loadTrait.load() when I add my CompanionAds to VAST xml.
    And that's why SMP hangs.
    Url to VAST file is still the same in both cases and file is accessible too
    Anybody knows why this loadError dispatches?

  • It is safe to enable ntfs write support in Lion?

    Hi,
    I wonder how stable is the unsupported ntfs write feature of Lion?
    http://forums.macrumors.com/showthread.php?t=785376
    Has anyone tried this?
    Thanks
    Oliver

    There actually is no problem with running it with the display lid closed as demonstrated by the lid-closed mode…
    http://docs.info.apple.com/article.html?artnum=86286
    Just be sure that youo do not block airflow out the back of your MBP as this is the new exhaust point as opposed to in front of the display and the grilles when the display is open.
    However, it's not recommended without an external display as there is no way to indicate its operational state. A running MBP in this state looks just like one that's off which can increase the chances of damage.

  • IDE CF Reader/Writer Support Q.

    I've managed to add support of IDE Compact Flash Readers to Solaris 8 x86. Required changes to Solaris sources are minimal (available at http://www.solarisworld.net).
    Whom of Sun people can I ask to incorporate these changes to Solaris (or to issue
    corresponding official patch) ?
    Sincerely,
    Maxim

    Quote
    Where can i get a tested hacked bios?
    Maybe this could fix my problems. Or the only change is the IDE?
    in my trouble shoot guide you will find a link about the hacked bios.
    a link to the guide can be found in my signature
    the MSI MEGA STICK should also work.
    installed usb drivers ?
    tried another usb cable ?
    tried it on a hub ?
    Quote
    My optical wireless mouse. When i turns on the computer, it works ok. If i restart, do not work. Restart again, works. And go on... Only this mouse. On this MB.
    usb or ps2 ?
    if ps2 then switch keyboard/mouse connectors.
    Quote
    And also with my sound output. The eletrical one (coaxial).
    It do not work with my 5.1 home system. It works fine with my old SB Live.
    i find this hard to believe also as alot of people can do this.
    if you want good help with this then its better to start your own thread instead of hijacking this one.
    also less confusing and more easy for us in here.
    also you will get better help if you make a signature of what you have.
    MSI MEGA STICK
    MSI K7N2 Delta ILSR.
    windows xp
    linux
    5.1 home system
    this is all the info you provided of what you have and it does not give much to go on.
    good luck and you know what to do if you want more help

  • Can't select text boxes with Type Tool to write in on pages, only on Master Page

    I'm unable to use the Type Tool to select the tax boxes on a document page in Indesign CC. I can select it on the Master Page. I can write on the Master Page. If I apply the Master Page afterwards, the written text from the Master Page appear on the document page, just as it should. But whenever I try to select a column on a document page, all the Type Tool does is draw a new text box (which I can select and write in). What's up with that? I applied the Master multiple times. If I can write on a the Master Page, why not on the document page?

    Individual master frames can be overridden on a document page by holding down Cmd + Shift (Mac) or Ctrl + Shift (Windows) and clicking on them with the Selection tool.
    Empty master text frames are generally more useful for placing external text files and having them flow from page to page than for typing, and they need not be overridden to do that -- just move the loaded cursor inside the frame.

  • Master data load: texts are not loaded

    Hi friends,
    Trying to load BW Hierarchy(0COSTCENTER) to BPC dimension(P_CC).
    Loadedd master data & text data using package "Import master data from BI infoobject"(/CPMB/IMPORT_IOBJ_MASTER), but EVdescription (texts) are not uploaded ino BPC dimension (P_CC).
    Because of above error, when i try to load hierarchy(0costcenter), sytem throwoing one more error(JScrpit evaluation error).
    Now i want to load texts into P_CC. ours is bpc 75nw sp10.
    Found 2 notes, but these are related to older support packges
    1462732 u2013 DM: text node descriptions canu2019t be imported.
    1531601 - Incident 737084 / 2010 / text nodes aren't loaded
    Transformation file:
    *OPTIONS
    FORMAT = DELIMITED
    HEADER = YES
    DELIMITER = TAB
    AMOUNTDECIMALPOINT = .
    SKIP = 0
    SKIPIF =
    VALIDATERECORDS=YES
    CREDITPOSITIVE=YES
    MAXREJECTCOUNT=-1
    ROUNDAMOUNT=
    *MAPPING
    ID=ID
    CURRENCY=0OBJ_CURR
    *CONVERSION
    DM package run:
    Infoobject: 0COSTCENTER
    set selection: Attributes Controlling area = SP00
                           Hierarhcy: import text node(yes), selected hierarchy, version(empty),memberid(SP001170),level(not filled)
                           language: English, medium description,
                          attiribute list: currency(0OBJ_CURRENCY),controlling area
    fileter by attributes or hierarhies option selection,
    Mode: Update
    Format: internal
    Dimension: P_cc
    package ended with error
    Failed to write text of master data; check the error message
    checked BPC dim, only member ID & currency is updated, but not evdescription.
    Can you please share valuable inputs.
    thanks,
    naresh

    resolved problem.
    Packages given bpc7.5 nw sp10 are is exactly working.
    Mapping section:
    ID=0CO_AREA+ID
    CURRENCY=0OBJ_CURRENCY
    becoz base members are automatically added with controlling area in BW hierarchy on 0costcenter.
    Followed method given in how to guide.

  • Can you enable CSS using Encore to write DLT with CSS?

    re: CSS Copy Protection
    I'm posting to find out if Encore can write a DVD master with CSS 'enabled' with the CSS keys turned on for replication mastering.
    It's as easy as clicking a radio button in Apple's DVD Studio Pro to write a DLT tape master with CSS enabled. We submit the DLT tape master with CSS 'enabled' to replication mastering dept. that then 'activates' the CSS keys to create a glass master and stamper with CSS copy protection. All DVD's pressed from a CSS enabled & activated stamper carry CSS copy protection on each DVD disc.
    Thank you.
    Brian alan

    Yes, Encore supports CSS flags for mastering to DLT for replication.

Maybe you are looking for