Question on Avro schema management

Hi,
in our use case, we need to generate Avro schema on the fly (given some business object structure) and install with Oracle NoSQL. I have
the following questions:
1. Is there an API to install the Avro schema in NoSQL. Ideally we'd like to avoid using the command line tool for this (and also creating
a .avsc file)
2. Any recommended way to make the Avro schema available on the client? Ideally we don't want to use any file system operations
for this. Would it be a reasonable way to store the Avro schema itself as a String in NoSQL and then when the client connects to NoSQL,
first thing it does is read the schemata stored in NoSQL and parse them?
On another topic, are there any performance penalties using JsonAvroBinding vs. GenericAvroBinding. Our objects are all JSON so we'd
like to use JsonAvroBinding, however we'd go the extra mile and use GenericAvroBinding if that performs better.
Best Regards and thanks in advance for your answer,
Ralf

Hello Ralf,
1. Is there an API to install the Avro schema in NoSQL. Ideally we'd like to avoid using the command line tool for this (and also creating a .avsc file)No, there is no administrative API currently available. So currently, I think this would have to be done using a script that is invoked by your application and that uses the NoSQL DB admin CLI.
2. Any recommended way to make the Avro schema available on the client? Ideally we don't want to use any file system operations for this. Would it be a reasonable way to store the Avro schema itself as a String in NoSQL and then when the client connects to NoSQL, first thing it does is read the schemata stored in NoSQL and parse them?The begs the question of how you'll do schema evolution. Will there ever be multiple versions of the same Avro schema (more than one version having the same schema name) in your application? If so, there will be additional complications with the approach you're taking.
If not (if there will only ever be one version of a given schema), you can use the latest (only) version of a schema on the client. In that case you can call AvroCatalog.getCurrentSchemas to get the schemas you need. If a schema you recently added is not in the returned map, call AvroCatalog.refreshSchemaCache followed by AvroCatalog.getCurrentSchemas.
On another topic, are there any performance penalties using JsonAvroBinding vs. GenericAvroBinding. Our objects are all JSON so we'd like to use JsonAvroBinding, however we'd go the extra mile and use GenericAvroBinding if that performs better.They should have similar performance characteristics -- they do essentially the same thing -- but I would guess that in general JsonAvroBinding is slightly faster than GenericAvroBinding, based on my knowledge of the Avro and Jackson code. However, we have not done any performance testing to compare them. It is possible that the answer depends on the schema you're using. So you should do your own testing, if you're concerned about minor performance differences.
--mark                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

Similar Messages

  • DBA Studio - Schema Management

    Under Schema Management in DBA Studio, the tables list consists of 'Table', 'Tablespace', 'Partitioned' and 'Rows'. Sometimes the Rows column contains the number of rows for each table and sometimes it's blank. Any idea why, and how I can set the display to report the number of rows when it is currently blank?
    Thanks,
    Mike

    I am getting the same issue .... I didn't find a response to this original question, from 2000.
    Anyone have an answer?
    When DBA Studio was first launched it picked up the service names from tnsnames.
    When I select File|Add Database to Tree nothing happens! So it is impossible to access a new database.
    Any suggestions?

  • Interview Questions related to Warehouse management

    Hi all
    Can u please help me regarding  Interview Questions related to Warehouse management
    Thanks and Regds
    Daniel

    Have you searched in very first thread
    [Warehouse Management?|New to Materials Management / Warehouse Management?;

  • URGENT : Challenge questions query: Oracle Access Manager 10g

    Hi all,
    This is a query regarding password challenge questions in Oracle Access Manager 10g. We have created password policies for a specific container in OID (say cn=xxx,cn=users,dc=oracle,dc=com) and it is working fine.
    In order to exclude certain set of users (say user ABC ) for password policies, we have set the obpasswordchangeflag to false for those users which are in same container for which password policy is created.
    When we try to login to the application with the user say ABC, I am not seeing any reset password page - I am happy till this point. However it is showing Configure Challenge questions page. Is there any way to bypass this page? Or is this the expected behavior?
    This is very urgent and prompt reply is very much appreciated.
    -Mahendra

    Hi Mahendra,
    This is expected behaviour. In order to exclude the password policy management for some certains user for particular domain/container. please add the below configuration parameter to your OAM10g password policy.
    Password Policy Filter Field     (!(|(cn=xxx)(cn=abc)))
    ----Ajay

  • Error when running "regsvr32 schmmgmt.dll" to add the Schema Management Snap In on Windows 8

    I am running Windows 8 Enterprise and trying to install the Active Directory Schema Management MMC Snap In.
    When I follow the procedure listed via the link below, it doesn't work, I get an error.
    http://technet.microsoft.com/en-us/library/cc732110.aspx      
    The error message that I get is shown below.
    I did a search and found schmmgmt.dll in the "C:\Windows\System32" folder, but if I do a "C:\> regsvr32 C:\Windows\System32\schmmgmt.dll", I still get the same error.
    Any ideas how I can register this .dll so that I can use the Active Directory Schema Management Snap In in Windows 8 Enterprise?
    I do not have this problem on Windows 7 or Windows XP, so I am thinking this must be a "Windows 8" thing.
    I have a support case open with Microsoft Premier Support and will post the resolution when I get it, but in the interest of saving time, if anyone already dealt with this and has a quick fix, I'd be happy to take a look at it.

    Hi,
    I have not found the files in my computer. Can you please double check that.
    Juke Chou
    TechNet Community Support

  • Questioned status in Fault Management for Cisco Prime 4.2

    Hi all,
    Need help in Cisco Prime 4.2. My device is stuck in Questioned state in Fault Management. The device though can be pinged from the server. Actually, I can already manage the device and have archived its configuration. Problem is, on Fault Monitoring Device Administration, its on Questioned state even though I already tried to rediscover the device several times.
    Do I need to configure something on the server like put in the IP address and hostname of the device in the host file of Windows Server 2008?
    Thanks in advance for your help!

    Hi ,
    Is this happenning for just one particular device or for all of them ?
    If for a particular device  then Are you using SNMPv2 or SNMPv3 on your device ?
    Disable the Windows Firewall and ANTI-Virus on the serevr and Rediscover the device again.
    Thanks
    Afroz

  • Avro schema - optional fields - gives "Not in Union" exception

    Hi all,
    I have a problem with using optional fields in an avro schema and using the JSONAvroBinding.
    If I have a User schema that has a first name field. The User can opt to provide the first name , or not. The field is optional from a readers perspective.
    (this is taken from  http://docs.oracle.com/cd/NOSQL/html/GettingStartedGuide/avroschemas.html which is nosql avro documentation)
      "type": "record",
      "namespace": "com.example",
      "name": "FullName",
      "fields": [
        { "name": "first", "type": ["string", "null"] },
        { "name": "last", "type": "string", "default" : "Doe" }
    Here if I supply this example as the Avro schema, and then omitt the first name when I write, it will work without problem. But when I attempt to write "John" it will fail with:
    Caused By: org.apache.avro.UnresolvedUnionException: Not in union ["string","null"]: "John"
             at oracle.kv.impl.api.avro.JsonBinding$JsonData.resolveUnion(JsonBinding.java:403)
             at org.apache.avro.generic.GenericDatumWriter.resolveUnion(GenericDatumWriter.java:144)
             at oracle.kv.impl.api.avro.JsonBinding$JsonDatumWriter.write(JsonBinding.java:599)
             at oracle.kv.impl.api.avro.JsonBinding$JsonDatumWriter.writeRecord(JsonBinding.java:695)
             at oracle.kv.impl.api.avro.JsonBinding$JsonDatumWriter.write(JsonBinding.java:565)
             Truncated. see log file for complete stacktrace
    This fails:
       "first" : "John",
       "last" : "Smith"
    This works:
       "last" : "Smith"
    It seems someone else had this problem and posted on AVROs site, where a response said it might be NoSQLs libraries fault:
    "The error is thrown from the Oracle's NoSQL library's use of Avro and is not clearly an Avro problem. You might be better off trying to get help for this from Oracle?"
    https://issues.apache.org/jira/browse/AVRO-1376
    Any thoughts? To me this seems like a bug in the JsonBinding class?

    According to this:
    http://www.oracle.com/technetwork/database/nosqldb/learnmore/nosqldb-faq-518364.html#HowtouseAvrounionstoencodeoptionalfields
    Sending in
       "first" : "John",
       "last" : "Smith"
    is not correct.
    Instead, sending in:
       "first" : {
         "string" : "John"
       "last" : "Smith"
    is working.

  • My question is how i manage that delta infopackage in my process chain

    Hello Sir,
    i have a delta infopackage which sciduled in a process chain but it does not pick any delta i have to manualy run repair full infopackage dally and then delta comes in to picture my target is a dso so it does't have any problem.
    the datasourse is costamize
    delta pointer is cal day
    my question is how i manage that delta infopackage in my process chain

    Hi
    IS the process type "delta infopackage " is executing in the process chain or not? Plz once check in SM37 Tcode . and Why r u running the repair full request infopackage . If u miss any delta records then only u have to run the repair full request . If delta records are not extracted then better to manually extract the delta infopackage.
    Plz once check in SM37 Tcode whether the execute infopackage process step is running or not? or any error has occured in that PC.
    Thanx & Regards,
    RaviChandra

  • Question on installing Access Manager 2005Q4

    Hello everyone,
    I have a question on installing access manager. It looks like access manager has to be installed into a web server running as root. The install program even warns you and gives you the option to fix it. After install does access manager still have to run as root, or can the web servers owner and group be changed back to webserved:webserved.
    It would be nice not to have to run the web server as root just to have access manager working.
    Also if it is possible to change the owner, could somebody point me to some directions to make sure I do it correctly.
    Thanks for your help,
    Gary

    Is it possible to have the ldap servers running on port 389 and the web server running on port 80.One way you can do this (if you are on Solaris 10) is to use RBAC with a user in the net_privaddr role. See http://www.sun.com/bigadmin/features/articles/least_privilege.html for more information.
    If a person already has an installed version as root, can it be changed to a non root user, or would it be just to much of a nightmare to do.That's what the doc describes how to do. Should not be a big problem but you might have to make a few adjustments depending on how far you've already gone with the install and config.
    Does the ldap server and web server having to be running as the same user?No, you can use separate users.
    HTH,
    David

  • Schema Management

    Howdy All,
    I am currently evaluating Qwest Software's Schema Manager to assist in maintaining multiple schemas. This product is a repository based application. We are currently using Designer just for a table/view/index/trigger repository. We use the scripts from Designer to build the tables/view/indexes/trigger in the remote scemas.
    It seems to me that Designer has source control options that seem like they would be very similary to the functionality that Quest's Schema Manager provides. I am also vaguley familiar with Oracle's Enterprise Manager and it seems to have some of the same types of fuctions to maintain schemas.
    Does anyone have any recommendations on Schema Management products?
    Thanks,
    Jeff

    as far as i know:
    With designer you can only view differences between repository and other schema. Not between two schemas.
    Peter

  • Questions on SAP Strategy Management

    Dear Experts,
    I am very new to SAP Strategy Management (SSM). I already tried to find some information about it in the web, but unfortunately most documents only provide high level information (mostly marketing slides). Therefore I would be grateful if you could answer the following questions:
    1. SSM provides charts for data visualization. Is there an overview of supported chart types? Is there a source which gives further information about chart customization?
    2. SSM provides a collaboration functionality that enables user to add comments. Can comments only be maintained on query level, or also by navigation state (e.g. comment is only shown, when navigating to Calendar Year 2006 and Company Code 4711)?
    3. Is it possible to print comments / export comments combined with charts / reports to PDF
    4. Can users upload documents (e.g. MS Word docs)?
    5. A new version was just released which is supposed to have a better integration with SAP BI. What are the improvements in terms of integration? How can SAP BI data be accessed?
    6. What are the current system requirements for SSM?
    7. Where can a documentation on SSM be found (I could unfortunately only find an installation guide on service.sap.com)?
    Thanks a lot for your help!
    Marco
    Edited by: Marco on Sep 15, 2008 10:22 AM

    Marco,
    Here is some information about SAP Strategy Management:
    1. SSM provides charts for data visualization. Is there an overview of supported chart types? Is there a source which gives further information about chart customization?
    Strategy Management provides out-of-the-box packaged reporting templates: Benchmarking, Trending, Percent Contributions within subtotals, Exceptions, Rankings, Ad-Hoc reporting of multiple dimensions & metrics.
    With Strategy Management, you can also provide links to reports or charts in other applications for further drill-down or exploration. 
    2. SSM provides a collaboration functionality that enables user to add comments. Can comments only be maintained on query level, or also by navigation state (e.g. comment is only shown, when navigating to Calendar Year 2006 and Company Code 4711)?
    Comments are added by users to specific areas and can be defined as to which user groups have access or visibility to these comments. These comments are directly associated with a specific area (i.e. objective, KPI, initiative, etc.) with a tagging icon to show individual users if there are new, unread, comments since their last access to system.
    Comments are added at the user interface level and would be stored in either the MaxDB or SQL database, depending on how the implementation was configured. 
    3. Is it possible to print comments / export comments combined with charts / reports to PDF
    Strategy Management has an Operational Review function that allows users to capture screenshots, annotate them and publish as a pdf report.
    4. Can users upload documents (e.g. MS Word docs)?
    Throughout Strategy Management is the ability to provide links to other reports, internal or external documentation, as well as other applications. Best practices would have an associated link to documents.
    5. A new version was just released which is supposed to have a better integration with SAP BI. What are the improvements in terms of integration? How can SAP BI data be accessed?
    The improvements are an administrator tool that provides a basic user interface to simplify the handling of BI connectivity: importing schemas, defining virtual measures, creating scorecard metrics, and importing data.
    6. What are the current system requirements for SSM?
    That information can be found in the installation guides.There is a Master Guide and a Sizing Guide which will both be helpful.
    7. Where can a documentation on SSM be found (I could unfortunately only find an installation guide on service.sap.com)?
    The best public resource for documention about SSM is the BPX Community> Enterprise Performance Management
    Hope this is helpful,
    Bob

  • Question for installing Solution Manager & ECC 5.0

    Any idea for installing Solution Manager 3.2 on Windows server 2003 with Oracle9i problem when install Database Instance. Installation failed when the intallation progress went to Oracle Post-Load Action.
    The message from startsap log file is
    "running C:\usr\sap\T01\SYS\exe\run/sapstart.exe name=T01 nr=03 SAPDIAHOST=saptest02 -Wait
    start service SAP01_03 on machine
    saptest02
    OpenService of SAPT01_03 failed. Error#: 1060
    CreateNamedPipe for
    saptest02\pipe\SAP01_03 Failed, Extended Error #2
    start service SAP01_03 on machine
    saptest02
    OpenService of SAPT01_03 failed. Error#: 1060
    C:\usr\sap\T01\SYS\exe\run/sapstart.exe=>sapparam(1c): No Profile Used."
    Another question is about installing the Oracle database software: should we choose Create Databse or not when install Oracle Server Software only?
    Is my installation process as following correct?
    ->SELECT A PRODUCT TO INSTALL:
      Oracle9i Database 9.2.0.1.0
    ->WHAT TPYE OF INSTALLATION DO YOU WANT:
      Enterprise Edition
    ->SELECT A DATABASE SUITED TO YOUR NEEDS:
      Software only
    After end of installation
    install Oracle9i Client 9.2.0.1.0->Administrator
    Thanks a lot

    Hi Shusen, I´m trying to do the same think (Install ECC IDES with Oracle 9i in one computer for educational propose), can you help me with this:
    1.I made the same Oracle install process because when I tried with sapserver.cmd nothing happened, for that reason i made:
    SELECT A PRODUCT TO INSTALL:
    Oracle9i Database 9.2.0.1.0
    ->WHAT TPYE OF INSTALLATION DO YOU WANT:
    Enterprise Edition
    ->SELECT A DATABASE SUITED TO YOUR NEEDS:
    Software only
    After end of installation
    I did not install client, is this correct?
    2.After install this, I run the sapins.exe but  show me this error: INSTALL FIRST SAP J2EE ENGINE, I download the JAVA SDK from JAVA page (java_ee_sdk-5-windows) but did not fix the problem: Do you know what file is this? Or, where is it in the DVD installation?
    Thanks in advance if you or somebody can help me and excuse me if the answers are obviously, but I´m not a system engineer I´m only try to install IDES for learn SAP WM.
    Thanks.

  • Questions on mobile device management

    Hi All,
    I'm not sure where to post this question since I couldn't find a forum specific to Afaria, so thought someone here might be able to help.
    1. Afaria mobile device management solution claims that data and content is backed up and can be deleted if a device is stolen or lost. Can this deletion be done if the mobile is switched off of the SIM card has been removed? What is the mechanism of the data deletion process when the device is either ON/OFF?
    2. How does Afaria handle online and offline user authentication? If a mobile app is opened, can Afaria be configured to force the user to enter credentials for authentication? Or should there be a separate login page as a part of the mobile app? (The user's credentials are needed to find his role from LDAP and the rest of the app to work properly, which is y the question).
    Thanks & Regards,
    Vaishnavi

    This forum is fine for Afaria discussions and questions, no worries. 
    1.  If mobile device is switched off or not network connected then Afaria is not able to do anything with that device.  The content though would be secured, encrypted etc. so that there should be no risk as long as the device is switched off.  The "kill device" command that can be sent from Afaria will work if device is turned on and connected to a network.
    2.  Afaria can force quite a lot of things and one of them is regarding the device itself, forcing a password/pin type of unlocking.  The mobile app normally has it's own mechanism for authentication, user name and password.  That is a SUP function and has little to do with Afaria, I don't believe Afaria can force that part of authentication. 
    You can get a good overview of the technical part of Afaria here:  [Afaria Technical White paper|http://www.sybase.com/files/White_Papers/Afaria-Technical-WP.pdf]

  • Questions on Un do Management.

    Howdy all. I havae a couple questions on this utility that I am hoping someone could assist with.
    1; The location of the Undo Management Screen can be found here: http://download-west.oracle.com/docs/cd/B19306_01/server.102/b14196/storage003.htm#CHDBAEDB
    but I simply don't have it in my 10g Enterprise Manager. I can see the Undo Tablespace, but not the Manager. Any ideas why?
    2; I understand there there are 3 types of Undo information (Uncommitted, Committed, and Expired), but I don't see the value of the last 2. For example, if a transaction is Committed, but still remains in the Undo file do to the retention period, what good is it? I don't know if there is any way this info can be used for anything once the transaction is committed, is there?
    TIA, ChrisR

    The retention is a suggestion, not an absolute rule. But yes, if the retention is specified as less than the longest running query in the system, you potentially run the risk of the dreaded ORA-01555 "snapshot too old". This error occurs when the read consistent view cannot be created. You won't see inconsistent data, Oracle doesn't allow that.
    Check out this discussion at AskTom for some details on how retention can cause snapshot too old errors.
    Message was edited by:
    rbglossip

  • Questions on JMX and management-config

    I was wondering if anyone can clarify the usage of management-config.
    We've got a setup with managed-nodes=all and allow-remote-management=true (other params defaulted). We've got processes that occasionally ping the cluster (via a single node) to log performance statistics and to look for problems that might require intervention (across all nodes via remote management).
    I'm trying to determine if the JMX subsystem is completely isolated from runtime cache performance.
    1) Does the setting for the read-only flag impact performance in any way? If set to false, is there any sort of locking or synchronization that takes place when querying cluster nodes?
    2) Do calls to JMX (and presumably the Invocation Service) share any resources with a Distributed Cache Service?
    3) the Default management-config settings in Tangosol-coherence.xml point to the "Management" service - which is not actually defined elsewhere in the configuration file. Is this actually an implicit link to the Invocation Service?
    4) Is there a single "Service Thread"? or does each distinct service have its own service thread?
    Thanks in advance,
    Dave

    The performance impact of management is relatively small. The consumption is based on the information "read" (getAttribute/getAttribute) and the frequency of the poll. Polls of the same data element within 1 second will receive the same result for remote nodes.
    The formula to determine the network consumption estimation formula for Coherence 3.3 on a single poll of the information is:
    Estimated network bytes per poll =
    Number of remote Node MBeans retrieved * 725
    + Number of remote Cache MBeans retrieved * 225
    + Number of remote Storage Manager MBeans Retrieved * 720
    + Number of remote Service MBeans Retrieved * 144
    + Number of remote Point to Point MBeans * (Number of Nodes in Grid -1 * 250)
    Given the order N size of the Point-to-Point MBeans, It is not recommended to put that information in a loop for a large cluster.
    1) Does the setting for the read-only flag impact performance in any way? If set to false, is there any sort of locking or synchronization that takes place when querying cluster nodes?
    EW: The Read-only flag does not impact performance. There is no synchronization on read of the objects. Synchronization on update is on an attribute by attribute basis.
    2) Do calls to JMX (and presumably the Invocation Service) share any resources with a Distributed Cache Service?
    EW: The JMX calls are processed through the Management (Invocation) Service. This shares system (memory, CPU, network) resources with other services. The management information is not processed out-of-band and under extreme load performance will be impacted.
    3) the Default management-config settings in Tangosol-coherence.xml point to the "Management" service - which is not actually defined elsewhere in the configuration file. Is this actually an implicit link to the Invocation Service?
    EW: The Management service is a non-configurable Invocation service.
    4) Is there a single "Service Thread"? or does each distinct service have its own service thread?
    EW : Not exactly sure I understand the question. Each service has its' own "Service" thread and thread pool. However, there are some shared components at the TCMP (network) layer.
    Hope this helps,
    Everett Williams
    Message was edited by:
    user631017
    Message was edited by:
    user631017

Maybe you are looking for