Decision to store attribute data in IDM

What's the deciding criteria to have attributes in IDM. If I have 40 attributes to be flown from one system to another system and then again to multiple systems. I have to use the same attributes flowing to various systems. In this case if I don't store this data in iDM then everytime I have to make connection to source and pull this data to flow to other systems. Won't this impact performance.
What is the deciding factor on whether to keep the specific attribute data in IDM or not ? Where will it impact performance? and what are the best practises to store IDM data?

the rule of thumb is to store as few as possible. The basic architecture of the product is to create a virtual directory of user information. Products like microsoft's MIIS store all data in a metaview, which essentially duplicates all data both on the native system as well as on the MIIS database.
With each attribute you add, you move more towards the meta view concept.
I agree with the comments above regarding deciding criteria on why you would want to keep a value on IDM. Other criteria to keep in mind are:
1) Are you getting this value from a resource on which you manage accounts, or is it simply used as a feed? If its simply a feed, does a spot exist for this value to be stored on a native system? If yes, who has accounts on that system. In other words, how important is the value to everyone?
2) do you need idm to search on it.
3) how often does IDM need to use this attribute. if you used it for tasks and other things quite often you most likely will not want to get a user view each time to retrieve the value. Thus, you are best off storing it locally.
4)Rule of thumb...if you think its best being stored in IDM....then i probably is. (I have at most stored 8-10 values in IDM in all of the 10 implmentations I've done of this product)
I hope this helps.
Dana Reed
AegisUSA
Denver, Co
[email protected]
AegisUSA

Similar Messages

How to store bit data in VARCHAR(4000) field?

Hi.
Please help!
We are porting some C/C++ software with embedded SQLs from NT/DB2 to Linux/Oracle.
On NT/DB2 we have some table to store file data in a VARCHAR(4000) blocks.
Table looks like this
CREATE TABLE FileData (filetime as timestamp not null, idx int not null, datablock varchar(4000) FOR BIT DATA not null, primary key (filetime, idx) );
As you can see DB2 has appropriate field modifier - "FOR BIT DATA" which makes DB2 storing data as-is, not converting characters.
I need to know - if it is possible to do the same in Oracle like in DB2?
If Oracle has some kind of field modifier like "FOR BIT DATA" in DB2?
If not, how can I do the same in Oracle?
The current problems are:
1) when application imports the file with some national chars the Oracle stores "?" in a database in place of national chars.
2) another piece of a problem - if file is more than 4000 bytes length, it reports the ORA-01461 error (see it is trying to expand some chars to UTF8 char which is not fit a single char, so finally - not fit the field size).
So, it seems that it cannot proceed national chars at all. :-\
For details please see enclosed [C code|http://dmitry-bond.spaces.live.com/blog/cns!D4095215C101CECE!1606.entry] , there is example how data written to a table.
In other places we also need to read data from FIELDATA table and store back to file (other filename, other location).
Here is summary on a field-datatype variants I have tried for the "datablock" field:
1) VARCHAR2, RAW, LONG RAW, BLOB - does not work! All reports the same error - ORA-01461.
2) CLOB, LONG - both working fine but(!) both still returns "?" instead of national chars on data reading.
Hint: how I did try these field types - I just drop the "FileData" table, created it using different type for "datablock" field and run the same application to test it.
I think I need to explain what the problem - we do not provide direct access to Oracle database, we use a some middle-ware. Middle-ware is a C/C++ software which also has a interface for dynamic SQLs execution. So, exactly this middle-ware (which is typically running on the same server with Oracle) receives the "?" instead of national chars! But we need it to return all data AS-IS(!) without any changes!!! That is wjhy I did ask - if Oracle has any options to store byte-data as-is?
The BIG QUESTION - HOW CAN WE DO THIS?!
Another thing I need to explain - it is ok to use Oracle-specific SQL ONLY IF THERE IS REALLY NO WAY TO ACHIEVE THIS WITH STANDARD SQL! Please.
So, please look on a C code (by link I have posted above) and tell - if it is possible to make working in Oracle the VARCHAR approach we using at the moment?
If not - please describe what options do we have for Oracle?
Regards,
Dmitry.
PS. it is Oracle 11gR2 on CentOS 5.4, all stuff installed with default settings, so Oracle db encoding is "AL32UTF8".
C/C++ application is built as ANSI/ASCII application (non-unicode), so sizeof(char)=1.
The target Oracle db (I mean - the one which will be used on customer site) is Oracle 10g. So, solution need to be working on Oracle 10g.

P. Forstmann wrote:
There is some contradiction in your requirements:
- if you want to store data as is without any translation use RAW or BLOB
- if you want to store national character data try to use NVARCHAR2 or NCLOB.Seems you did not understand the problem. Ok, I'll try to explain. Please look on the code sample I provided in original question
(I just added expanded data structures there, sorry I forgot to publish them when post original question):
EXEC SQL BEGIN DECLARE SECTION;
struct {
    char timestamp[27];
    char station[17];
    char filename[33];
    char task[17];
    char orderno[17];
    long filelen;
gFilehead;
struct {
    char timestamp[27];
    long idx;
    struct {
      short len;
      char arr[4001];
    } datablock;
gFiledata;
EXEC SQL END DECLARE SECTION;
#define DATABLOCKSIZE 4000
#ifdef __ORACLE
#define VARCHAR_VAL(vch) vch.arr
#elif __DB2
#endif
short dbWriteFile( char *databytes, long datalen )
short nRc;
long movecount;
long offset = 0;
gFilehead.filelen = gFilehead.filelen + datalen;
while ((datalen + gFiledata.datablock.len) >= DATABLOCKSIZE)
    movecount = DATABLOCKSIZE - gFiledata.datablock.len;
    memcpy(&VARCHAR_VAL(gFiledata.datablock)[gFiledata.datablock.len], databytes, movecount);
    gFiledata.datablock.len = (short)(gFiledata.datablock.len + movecount);
    exec sql insert into filedata (recvtime, idx, datablock)
      values(
        :gFiledata.recvtime type as timestamp,
        :gFiledata.idx,
        :gFiledata.datablock /* <--- ORA-01461 appears here */
    nRc = sqlcode;
    switch (nRc)
    case SQLERR_OK: break;
    default:
      LogError(ERR_INSERT, "filedata", IntToStr(nRc), LOG_END);
      exit(EXIT_FAILURE);
    offset = offset + movecount;
    datalen = datalen - movecount;
    gFiledata.idx = gFiledata.idx + 1;
    memset(&gFiledata.datablock, 0, sizeof(gFiledata.datablock));
    databytes = databytes + movecount;
    gFiledata.datablock.len = 0;
if (datalen + gFiledata.datablock.len)
    memcpy(&VARCHAR_VAL(gFiledata.datablock)[gFiledata.datablock.len], databytes, datalen);
    gFiledata.datablock.len = (short)(gFiledata.datablock.len + datalen);
return 0;
}So, the thing we need is - to put some data into the "datablock" field of following structure:
struct {
    char timestamp[27];
    long idx;
    struct {
      short len;
      char arr[4001];
    } datablock;
gFiledata;Then insert it into a database table using static SQL like this:
    exec sql insert into filedata (recvtime, idx, datablock)
      values(
        :gFiledata.recvtime type as timestamp,
        :gFiledata.idx,
        :gFiledata.datablock /* <--- ORA-01461 appears here */
        ); And then expect to read exactly the same data back!
The problems are:
1) Oracle make decision to convert the data we are inserting (why? and how to disable converting?!)
2) even if it inserts the data (CLOB and LONG field datatypes are working fine when inserting data with such static SQL + such host variable) then it became not readable! (why?! how to make it readable?!)
P. Forstmann wrote:
ORA-01461 could mean that you have a wrong data type for bind variable variable in your client code:Not me decided that host variable is the "LONG datatype value" - the Oracle make that decision instead of me. And that is the problem!
Looks like Oracle react on any char code >= 0x80.
So, assume if I run the code:
// if Tab1 was created as "CREATE TABLE Tab1 (value VARCHAR(5))" then
char szData[10] = "\x41\x81\x82\x83\x84";
EXEC SQL INSERT INTO Tab1 (value) VALUES (:szData);
Oracle will report the ORA-01461 error!
EXACTLY THIS IS THE PROBLEM I HAVE DESCRIBED IN MY ORIGINAL QUESTION.
So, problem - why Oracle make such decision instead of me?! How we can make Oracle insert data into a table AS-IS?
What other type of host variable we should use to make Oracle think that data is a binary?
void*? unsigned char? Could you please provide any examples?
Ok, you did recommend - "use the RAW datatype". But RAW datatype is limited to size 2000 bytes only - we need 4000! So, it is not match our needs at all.
Also you have mentioned "use BLOB" - but testing shows that Oracle reports the same ORA-01461 error on inserting data into a BLOB field from such host variable! (see the code I posted)
What also we can do?
Change type of host variables? BUT HOW?!

Need to read a XML file and store multilingual data

I am having an XML file which contains multiple records and each maybe in a different language .identified EN -english ES-Spanish etc
- <Document xmlns="http://www.xxxxx.com/ws/integration/toolkit/2011/05">
- <Attributes>
<Attribute name="duration">0:00:02.993</Attribute>
<Attribute name="count">47</Attribute>
<Attribute name="entity">Requisition</Attribute>
<Attribute name="mode">XML</Attribute>
<Attribute name="version">http://www.xxxx.com/ws/tee800/2009/01</Attribute>
</Attributes>
- <Content>
- <ExportXML xmlns="http://www.xxxxx.com/ws/integration/toolkit/2005/07/action/export">
- <record>
<field name="ContestNumber">120000002O</field>
<field name="JobInformation,JobType,Description">Standard</field>
<field name="JobFamily">ACCOUNTING/FINANCE</field>
<field name="JobInformation,Organization,Name">CHMS-DO NOT USE</field>
<field name="Country">USA</field>
<field name="State">Illinois</field>
<field name="City">Lake County</field>
<field name="Title_EN">TaTest1</field>
<field name="Title_es">TaTest1 translated to Espanol</field>
<field name="InternalDescription_EN">Humira marketing team - develop programs.</field>
<field name="InternalDescription_zhCN" />
<field name="InternalDescription_zhTW" />
<field name="InternalDescription_es">Development of marketing programs for </field>
<field name="ExternalDescription_EN">Marketing programs for core products</field>
<field name="ExternalDescription_zhCN" />
<field name="ExternalDescription_zhTW" />
<field name="ExternalDescription_es">Marketing core products - Spain</field>
<field name="URL_en">http://[ZONE]/careersection/[CAREER_SECTION]/jobdetail.ftl?lang=en&job=120000002O</field>
<field name="URL_zhCN" />
<field name="URL_zhTW" />
<field name="URL_es">http://[ZONE]/careersection/[CAREER_SECTION]/jobdetail.ftl?lang=es&job=120000002O</field>
<field name="PostedExternally">true</field>
<field name="PostedInternally">true</field>
<field name="EnglishActive">true</field>
<field name="SimplifiedChineseActive">false</field>
<field name="TraditionalChineseActive">false</field>
<field name="SpanishActive">true</field>
<field name="InternalBonusTracking" />
<field name="ExternalBonusTracking" />
<field name="POSTING_GRADE" />
<field name="SAP_Schedule">Full-time</field>
<field name="PostingDateExternal">2012-11-20</field>
<field name="PostingDateInternal">2012-11-20</field>
</record>
</ExportXML>
</Content>
</Document>
I need to store and retrieve data into a AL32UTF8 database without losing language attributed.
I am using DBMS_XMLDOM.getnodevalue (); to fetch the XML stored in a CLOB column
But the package returns VARCHAR2 .How do i return NVARCHAR2 so that i can store Multilingual data
DBMS_XMLDOM.GETNODEVALUE(
n IN DOMNode)
RETURN VARCHAR2;
Or is there an easier way around using XMLTYPE
Edited by: Rameshkumar T on Nov 27, 2012 6:14 AM

dbms_lob.loadclobfromfile( v_xml_msg
                                      , v_xml_bfile
                                      , dbms_lob.getlength(v_xml_bfile)
                                      , v_dest_offset
                                      , v_src_offset
                                      , NLS_CHARSET_ID('AL32UTF8')
                                      , v_lang_context
                                      , v_warning
SELECT message
   INTO   v_xml_clob
   FROM   gjb_xml_message gtmq
   WHERE message_id = v_msg_id;
   v_line_no := 1;
   v_doc     := dbms_xmldom.newDOMDocument(v_xml_clob);
   v_line_no := 2;
   v_nodes    := dbms_xmldom.getElementsByTagName(v_doc, '*');
   FOR i IN 0..dbms_xmldom.getlength(v_nodes)-1
   LOOP
       BEGIN
           v_line_no := 3.0;
           v_element_x := dbms_xmldom.makeelement(xmldom.item(v_nodes,i));
           v_line_no := 3.1;
           v_node       := dbms_xmldom.item(v_nodes,i);
           v_line_no := 3.2;
           v_tag        := dbms_xmldom.getNodeName(v_node);
           v_line_no := 3.3;
           v_node_2     := dbms_xmldom.getfirstchild(v_node);
           v_line_no := 4.0;
           v_node_map     := DBMS_XMLDOM.getattributes (v_node);
           FOR x in 0 ..DBMS_XMLDOM.getlength (v_node_map)- 1
           LOOP
              BEGIN
                 v_line_no := 4.1;
                 v_one_node := DBMS_XMLDOM.item (v_node_map, x);
                 v_line_no := 4.2;
                 v_attrname := DBMS_XMLDOM.getnodename (v_one_node);
                 v_line_no := 4.3;
                 v_attrval := DBMS_XMLDOM.getnodevalue (v_one_node);
                 IF v_attrval = 'ContestNumber' THEN
                      v_line_no := 4.4;
                      v_contest_num := v_tag_value;
                      v_rec_no := NULL;
                      IF v_load_type = 'I' THEN
                         v_rec_no := fn_get_job_id(v_contest_num);
                      END IF;
                      IF v_rec_no IS NULL THEN
                         SELECT seq_gjbjobid.NEXTVAL
                         INTO   v_rec_no
                         FROM   dual;
                      END IF;
                 END IF;
IF UPPER(v_tag) = 'FIELD' THEN
         BEGIN
            v_line_no := 5;
            INSERT INTO gjb_xml_data
                   ( message_id
                   , job_id
                   , tag_name
                   , col_name
                   , col_no
                   , tag_level
                   , tag_value
                   , tag_lang
                   , tag_value_clob
            SELECT v_msg_id
                 , v_rec_no
                 , tag_name
                 , col_name
                 , col_no
                 , tag_level
                 , v_tag_value
                 , tag_lang
                 , v_tag_value_clob
            FROM   gjb_xml_tags gxt
            WHERE tag_name = v_attrval;
            v_tag_value := NULL;
            v_tag_value_clob := NULL;Edited by: Rameshkumar T on Nov 27, 2012 8:27 AM

How to store context data into a database table?

Hi All,
I am very new to Web Dynpro ABAP.
I am trying to store context data into database table. For this i need to write some code.
I have created one context attribute to store data and i have one database table.
Know i want to store that context attribute's data into database table.
Can anyone provide me necessary code to do this.
Thanks in Advance!
Regards,
Sreelakshmi.

Hello Sreelakshmi,
i think there would be some button and when u click that, the data of the context need to get saved into the database.
For the button,create an action.
in the action handler write the following code.
DATA lo_nd_kna1 TYPE REF TO if_wd_context_node.
DATA lo_el_kna1 TYPE REF TO if_wd_context_element,
DATA lt_kna1 TYPE wd_this->elements_znode.
DATA ls_kna1 TYPE wd_this->element_znode.
lo_nd_kna1 = wd_context->get_child_node( name = wd_this->wdctx_znode ).
lo_el_kna1 = lo_nd_kna1->get_element( ).
lo_el_kna1->get_static_attributes( IMPORTING static_attributes = ls_kna1 ).
modify kna1 from ls_kna1.
Regards
Sajid

How to store xml data into file in xml format through java program?

HI Friends,
Please let me know
How to store xml data into file in xml format through java program?
thanks......
can discuss further at messenger.....
Avanish Kumar Singh
Software Engineer,
Samsung India Development Center,
Bangalore--560001.
[email protected]

Hi i need to write the data from an XML file to a Microsoft SQL SErver database!
i got a piece of code from the net which allows me to parse th file:
import java.io.IOException;
import org.xml.sax.*;
import org.xml.sax.helpers.*;
import org.apache.xerces.parsers.SAXParser;
import java.lang.*;
public class MySaxParser extends DefaultHandler
private static int INDENT = 4;
private static String attList = "";
public static void main(String[] argv)
if (argv.length != 1)
System.out.println("Usage: java MySaxParser [URI]");
System.exit(0);
String uri = argv[0];
try
XMLReader parser = XMLReaderFactory.createXMLReader("org.apache.xerces.parsers.SAXParser");
MySaxParser MySaxParserInstance = new MySaxParser();
parser.setContentHandler(MySaxParserInstance);
parser.parse(uri);
catch(IOException ioe)
ioe.printStackTrace();
catch(SAXException saxe)
saxe.printStackTrace();
private int idx = 0;
public void characters(char[] ch, int start, int length)
throws SAXException
String s = new String(ch, start, length);
if (ch[0] == '\n')
return;
System.out.println(getIndent() + " Value: " + s);
public void endDocument() throws SAXException
idx -= INDENT;
public void endElement(String uri, String localName, String qName) throws SAXException
if (!attList.equals(""))
System.out.println(getIndent() + " Attributes: " + attList);
attList = "";
System.out.println(getIndent() + "end document");
idx -= INDENT;
public void startDocument() throws SAXException
idx += INDENT;
public void startElement(String uri,
String localName,
String qName,
Attributes attributes) throws SAXException
idx += INDENT;
System.out.println('\n' + getIndent() + "start element: " + localName);
if (localName.compareTo("Machine") == 0)
System.out.println("YES");
if (attributes.getLength() > 0)
idx += INDENT;
for (int i = 0; i < attributes.getLength(); i++)
attList = attList + attributes.getLocalName(i) + " = " + attributes.getValue(i);
if (i < (attributes.getLength() - 1))
attList = attList + ", ";
idx-= INDENT;
private String getIndent()
StringBuffer sb = new StringBuffer();
for (int i = 0; i < idx; i++)
sb.append(" ");
return sb.toString();
}// END PRGM
Now , am not a very good Java DEv. and i need to find a soln. to this prob within 1 week.
The next step is to write the data to the DB.
Am sending an example of my file:
<Start>
<Machine>
<Hostname> IPCServer </Hostname>
<HostID> 80c04499 </HostID>
<MachineType> sun4u [ID 466748 kern.info] Sun Ultra 5/10 UPA/PCI (UltraSPARC-IIi 360MHz) </MachineType>
<CPU> UltraSPARC-IIi at 360 MHz </CPU>
<Memory> RAM : 512 MB </Memory>
<HostAdapter>
<HA> kern.info] </HA>
</HostAdapter>
<Harddisks>
<HD>
<HD1> c0t0d0 ctrl kern.info] target 0 lun 0 </HD1>
<HD2> ST38420A 8.2 GB </HD2>
</HD>
</Harddisks>
<GraphicCard> m64B : PCI PGX 8-bit +Accel. </GraphicCard>
<NetworkType> hme0 : Fast-Ethernet </NetworkType>
<EthernetAddress> 09:00:30:C1:34:90 </EthernetAddress>
<IPAddress> 149.51.23.140 </IPAddress>
</Machine>
</Start>
Note that i can have more than 1 machines (meaning that i have to loop thru the file to be able to write to the DB)
Cal u tellme what to do!
Even better- do u have a piece of code that will help me understand and implement the database writing portion?
I badly need help here.
THANX

Store form data into a database and send via e-mail

Hello!
Perhaps my question is very obvious , but I don�t use to program, so I hope you can understand it.
I am creating a form in html (formulario.html) , the action for this form is to go to a jsp page (enviocorreo.jsp) that uses a javabean (SendMail.java) to send all the data entered in that form via e-mail to different people depending on the data chosen in some SELECT boxes.
But now, I want also to store all this information into a database. And here is my question.
Can I use another bean in enviocorreo.jsp to program the connection to the database and store the data into it?
Or should I use the same bean SendMail.java?
Or should I program all this code in enviocorreo.jsp?
Hope you can clarify , since I�m a bit confused about this.
Thank you very much,

I would recommend non of the above. Rather...
Have the action attribute form in formulario.html call a Servlet via POST. Have the servlet both store the data and email the recipients. Then afterwards, have the if both operations (store and email) are successful, forward to enviocorreo.jsp (removing the SendMail bean as you no longer need it), or if either step fails, forward to a error page.
All that code in a JSP is ugly. Besides, using a bean you'll have to pass some Context back and forth so the bean can do a lookup, etc. Yuch.

How to store the data, which should accessed by all the users

I want to store some data into some variables, which has to be accessed by all the users on the webserver. i think it has to be stored in the application memory but if any body gives the code it will be clear to me .
Thank Q
K.Srinivas

if it is for the same webapplication you can keep it in static attributes in a class which can be loaded at the time of server startup

Core data: Versioned model migration with change in existing attribute data types.

Hi ,
I want to upgrade my ios app with app store version with enhancement of new functionality related to core data features in the app.
-In new upgarde version, I want to change data types of attribute which is already present in core data model of existing app store version.
e.g.In Version 1.0 ,Attribute "date" datatype is "NSDate", New change required to change datatype "NSDate" to "NSString" with new version model.
I followed Lightwaight migration, but as per documentation , Lightwaigh migration not support for change data type of any existing attribute/entity of core data model.
Please suggest optimized solution for migration of database along with change in data type of exsiting attribute of the entity in core data.
If required in further info ,please ask.
Thanks in advances.
Regards,
Laxmikant

More Info: The two entries are actually pointing to the same object. If I save the context and restart, I only have one entry (I can also see this by looking at the XML store).
It seems that the NSTableView is getting messed up somehow after the FetchRequest. Still stumped.

How can i get to itunes to store all data on an external drive

how can i get to itunes to store all data on an external drive rather than the drive ITUnes run off. I can get photos and music off but my apps and movies seem to go to the drive where itunes is run from?

See if this helps:
http://support.apple.com/kb/HT1364

Can i use OER to store the data from a excel sheet that pertains to the entire integrations ?

hi ,
i know that the OER can be used to view the entire landscape for the SOA composites and how they are related with each other. However we have a requirement wherein we need to store the data for the entire integration end systems e.g. ebiz, mfgpro, siebel etc ( that is we need to store data one level up).
Also, we want a customized form in OER wherein user can manually add data regarding the integrations.
So is it possible to do so ? If yes, how ?

ok, let me put it this way,
I tried using the import/export utility available under OER admin tab.
When i export my existing assets it generates the .xml file for each asset. Now as i have hundreds on new assets to be created for each asset type i want to be able to create a new .xml file and want it to create the new asset once i import it using import utility. I tried creating a new .xml file giving it a new UUID but it does not seem to work. Has anyone tried this earlier who can give the steps to do this ?

I am receiving the data through the rs232 in labview and i have to store the data in to the word file only if there is a change in the data and we have to scan the data continuasly how can i do that.

i am receiving the data through the rs232 in labview and i have to store the data in to the word or text file only if there is a change in the data. I have to scan the data continuasly. how can i do that. I was able to store the data into the text or word file but could not be able to do it. I am gettting the data from rs232 interms of 0 or 1. and i have to print it only if thereis a change in data from 0 to 1. if i use if-loop , each as much time there is 0 or 1 is there that much time the data gets printed. i dont know how to do this program please help me if anybody knows the answer

I have attatched the vi. Here in this it receives the data from rs232 as string and converted into binery. and indicated in led also normally if the data 1 comes then the led's will be off. suppose if 0 comes the corresponding data status is wrtten into the text file. But here the problem is the same data will be printed many number of times. so i have to make it like if there is a transition from 1 to o then only print it once. how to do it. I am doing this from few weeks please reply if you know the answer immediatly
thanking you
Attachments:
MOTORTESTJIG.vi ‏729 KB

Which table stores the data of transaction FBL1N...?

Hi,
Please help me find out which table stores the data ,generated from transaction FBL1N..Actually i need to find out the g/l account against the vendor account that is being displayed in FBL3N's document overview.

Hi,
Data will be retrieved from following table :
tables: lfa1, lfb1, bsik, bsid, kna1, t001,t005, SKAT, SKB1.
In BSIK you have both LIFNR and HKONT. You will get the data based on the LIFNR and HKONT. LIFNR is Vendor and HKONT is GL assigned to the vendor.
Thanks,
Sriram Ponna.
Message was edited by:
Sriram Ponna

How to store the data coming from network analyser into a text or excel file

Hii everyone
I'm using Agilent 8719ET network analyser and wish to store the data coming from netowrk analyser into a text file/ excel file.
Presently I'm able to get the data on Labview graph using GPIB . Can anyone suggest how to go ahead after collect data sub vi. How can the data be stored into a file apart from showing on the graph?
Attached is the vi for kind consideration...
Looking for help
Regards
Rohit
Attachments:
Agilent 87XX Series Exceed Max Meas.vi ‏43 KB

First let me say that your code really looks pretty good. The data handling could be made more efficient by calculating the number of datapoints that are going to be in the completed dataset and preallocating the entire array -- but depending upon your answer to my questions, the logic in the lower shift register may be going away - so we won't worry about that right now.
The thing I need to know before addressing the data storage question is: Each time you call "Collect and Display Data.vi", how many element are in the array? Are you reading single data points, or a group of data? (BTW: if the answer to that question is obvious based on the way the other VIs are setup, I don't have the drivers so I can't tell what the setup values are.) Second, how fast does the loop iterate? Are we talking msec per loop?, seconds? fortnights?
The issues here are two-fold: how much data? and how fast is it coming? The answer to these will tell you how to save the data.
Mike...
Certified Professional Instructor
Certified LabVIEW Architect
LabVIEW Champion
"... after all, He's not a tame lion..."
Be thinking ahead and mark your dance card for NI Week 2015 now: TS 6139 - Object Oriented First Steps

I DON'T want to store any data on my MBA. I want to store all data or 90% of it on a NAS

All I have is a 13inch Macbook Air mid2011 128gb flash storage. And the expertise from you guys able to reply to me *
My goal is to set up a NAS ( how do I do this?)... as of writing I am intending to buy an airport express 802.11n.
Will the airport express allow my MBA and any other device for that matter to print wirelessly?
Can I connect sub/sound systems wirelessly to Itunes library through airport express.
Next I want to buy an Imac to act as a desktop but also as Server. I don't want to rely on my MBA to hold data as I want it to be purely for carrying out task optimally. *So for your answers sake please reply as if I'm ignorant to computing as I am largely hoping to learn almost step by step method to carry out this endeavour of mine.
Should the IMAC be connected to a NAS- buy a DS411j or DROBO FS? ---> and the NAS be connected to the airport express---> and the airport express is the gateway for any device including my MBA to pick up data (like to print), store away data (resumes,essays), play data (movies,music), act as a backup (imac holds storage, NAS holds a copy of storage in case imac fails or vice versa.
this might give current context: linksys router (lounge room) ---> macbook air (m/r). my room = m/r
this is dream context: linksys router (lounge room) ---> macbook air (m/r) --->airport express (m/r) --->nas (m/r) ---> imac(m/r)
\--->brothers laptop (his room,he can now also print wirelessly, watch movies wirelessly from the nas, save resumes/essays to nas etc)
That is ultimately my desireable outcome, but I am stupid and want to make sure it 100% correct and functional! Now.. is this just a pipe dream?! Can I do it with just the replys or email from you guys?Should I get someonelse to do it for me? Or is it going to be bottlenecked and this scenario won't work at all?
If I should chop and change the supply chain management of devices, please educate me. I am not claiming to know much. But I am totally here to learn from you 5x,10x more than I wrote. Maybe it's easier if I contact you through email.
Sorry if I wasted your time, If any one would like to help me take this challenge; break all this down to where to begin and how to move on to next step. Should I buy all of this at once. or step by step.
Even if you read thru all this and don't have time to reply huge amounts, please just redirect me with links.
Finally thanks

There is a world of information in these forums if you use the search function near the top right of this page. Just type in NAS for example and you get many threads on the subject (marked with a green checkmark if it solved the question) another example would be Airport Exterme and sound system. Once you formulate your ideas better then specific questions can be addressed one at a time. You may find that a less expensive choice for a server might be a mac mini. Good luck with your project, ask more specific questions and update you systems profile.

How to store measurement data in a single database row

I have to store time-data series into a database and do some analysis using Matlab later. Therefore the question might be more a database question rather than Diadem itself. Nevertheless I'm interested if anyone has some best practices for this issue.
I have a database which holds lifecycle records for certain components of same nature and different variants. Depending on the variant I have test setups which record certain data. There is a common set of component properties and a varying number of environmental measurements to be included. Also the duration of data acquisition varies across the variants.
Therefore having tables appears to be non-optimal solution for storing the data because the needed number of columns is unknown. Additionally I cannot create individual tables for each sample of a variant. This would produce to many tables.
So there are different approaches I have thought of:
Saving the TDM and TDX files as text respectively as BLOB
This makes it necessary to use intermediate files.
Saving the data as XML text
I don’t know yet if I can process XML data in Matlab
Has anybody an advice on that problem?
Regards
Chris

Chris
Sorry for the lateness in replying to your post.
I have done quite a bit of using a Database to store test results. (In my case this was Oracle DB, using a system called ASAM-ODS)
My 2 Cents:
Three functions were needed by users for me. 1) To search and find the tests, and 2) To take the list of Tests and process the data into a report/output summary. 2) If the file size is large, then being able to import the data quickly into analysis tool speeds up processing.
1) Searching for test results.  This all depends on what parameters are of value for searching. In practice this is a smaller list of values(usually under 20), but I have had great difficulty getting users to agree on what these parameters are. They tend to want to search for anything.   The organization of the searching parameters has direct relationship to how you can search. The NI Datafinder does a nice job of searching for parameters, so long as the parameter data are stored in properties of Channel Groups or Channels. It does not search or index if the values are in channel values.
Another note: Given these are searchable parameters, it helps greatly if these parameters have a controlled entry, so that the parameters are consistent over all tests, and not dependent on free form entry by each operator. Searching becomes impossible if the operators enter dates/ names in wildly different formats.
2) Similar issue exists if put values into databases. (I will use the database terms of Table and column(Parameter) and Row (instance of Data that would be one test record.)
The sql select statement, can do fast finds, if store the searchable parameters in rows of a table. Where would have one row for each Test Record.   The files I worked with have more than 2000 parameters.   Making a table that would store all of these, and be able to search for all of these, makes a very large number of rows. I did not like this approach, as it has substantial maintenance time, and when changes are made, things get ugly quick.
3)This is where having the file format be something that the analysis tool can quickly load up is beneficial.   Especially if the data files are large. In DIAdem's case, it reads TDM,TDMS files very quickly into the dataportal.   It can also read in the MDF or HDF files, but these are hierarchical structures that require custom code to traverse the information, and get the information into dataportal to use in Analysis /reporting. (Takes more time to read data, but have much more flexibility in the data structure than the two level tdm/tdms format.)
My personal preferences
I would not want to put the test data into a Table row. Each of the columns would be fixed and the table would be very wide in columns.
>
I personally like to put the test Data into a file, like TDMS, MDF, or HDF and then the database would have a entry for the reference to the attachment. The values that are in the database is just the parameters that are used for test Searching, either in datafinder or in sql commands in the user interface.
Hopefully these comments help your tasks some.
Respectfully,
Paul
tdmsmith.com

Decision to store attribute data in IDM

Similar Messages

Maybe you are looking for