TREX Alerts on unloaded indexes

Hello,
I recently got several alerts from TREX containing the following message :
hpa_1 : unloads
Returns any index that was unloaded from memory
>Decrease the number of loaded indexes
followed by the list of BIA appliance hosts w/ list of indexes.
What does this kind of alert mean and in which ways can i correct this ?
Thanks,
Ben

Hi,
I agree Mikael's reply. You need to ensure that you donot overload the BIA with more indexes. This might bring the blade down very often and make BIA unstable.
1. You need to know how much capacity you have on BIA. Generally each blade has either 8 or 16 GB capacity. However, you can use only half of it for indexes and rest is used by SAP for processing purposes.
2. Now you can know the size of cube and its dimension tables from DB02. put cubename (so that it includes E, F and D tables).
3. You can approximate the master data tables sizes. Since it is shared, there is not perfect way of estimating its size.
4. So if you have an infocube of size 10GB (E, F, D and S, X, Y tables) and let say you have 3 blades fo 8 GB capacity. You can put it without any issues. However, let say you have 2 blades, so total usable is 8GB, 2gb exceeds, you can still put it on BIA, but you will see the memory overflow problem and blade goes down when there is huge reporting activity.
5. Also you can ZZ_BIAMEMCONSUMPTION programs as given in the SAP note 917803 to do capacity planning for BIA.
Thanks,
Srikanth.

Similar Messages

Same TREX server for KM indexing and e-Recruitment

Hi,
Is it possible to use the same TREX server for KM indexing on the portal and e-Recruiting searches on R/3?
Many thanks
Jane

Hi,
in general and from a technical view it's possible.
But it depends on the load of the applications, perhaps it's a better approach to separate them e.g. for a productive environment.
Regards, Thorsten

Talent Management - TM - Trex 7.1 - Delta Indexing

luke.....are you out there??
congrats on your blog being featured right on the SDN homepage... very nice...
http://scn.sap.com/community/erp/hcm/blog/2010/09/20/setting-up-netweaver-embedded-search-trex-for-sap-ehp4-talent-management
and congrats to Chris on his first two excellent blogs....
http://scn.sap.com/people/chris.mcnarney/blog/2010/08/26/whats-included-with-the-predefined-performance-management-process
http://scn.sap.com/people/chris.mcnarney/blog/2010/09/09/whats-included-with-the-predefined-performance-management-process--part-2
all 3 blogs are very helpful since there is little information available out there on these topics...
so we've been testing the delta indexing program very heavily - ESH_IX_PROCESS_CHANGE_POINTERS
we have found that it does not appear to be able to index new hires (new central_person index does not pick up the new CP). The only way this data can be indexed is by running a full re-index. That is problematic for us, b/c we were hoping to only do full re-indexing 1 a week or even 1 a month. our indexes take 2-3 hrs to complete and trex searching is pretty much inoperable during that time.
Have you tested new hires with delta indexing? it seems as a gap in the change_pointers program. We opened up OSS message to SAP.
some additional thoughts working with the program, relative to your blog. I would highly recommend that anyone testing this makes sure the following notes are implemented in your system. The first one is the most recent and we ourselves did not have that implemented.
1. 0.350 BC-EIM-ESH 1441190 Error in model assignments to logical system 24.02.2010
2. 0.230 BC-EIM-ESH 1408655 Alerts in syntax check due to unused indexes 18.11.2009
3. 0.260 PA-TM 1395703 Positions and termination are missing for indexing 30.10.2009
4. 0.330 BC-EIM-ESH 1249482 Functional corrections for Enterprise Search 7.01 SP03 26.01.2009
Another area which we found from testing: SAP by default does not delta index structural authority view. What this means is that if a new talent specialist is added with 741 relationship there access to see that structure will not be available in TREX search by default delta indexing. This would also impact existing organizations and positions shifted under existing 741 relationships.
The information in spro is actually quite helpful, you can find it in: talent management and talent development > basic settings > search > BAdI: Activate Delta Indexing for Authorization Data
Activtate the BADI, than the program to "create the change pointers" must run periodically in your system. This is done with RPTMC_CREATE_CHANGEPOINT_AUTH. Once that program creates the change pointers the next time your scheduled delta program runs (ESH_IX_PROCESS_CHANGE_POINTERS) all of the structural auths will be created and indexed correctly.
If we can just now get new hires to work with ESH_IX_PROCESS_CHANGE_POINTERS we will probably only run the full re-index once a week or once a month.
Let me know your thoughts,
Michael
Message was edited by: Luke Marson
Message was edited by: Luke Marson

so if anyone is interested, from my previous post I mentioned that new hires were not getting picked up by the change pointers program.
after further testing though, we found that when the authorization recon program identifies the new hires and appropriately creates a change pointer.
conclusion: to avoid full re-indexing of trex indexes, perform the following steps:
1. implement / activate the BADI - HRTMC_AUTHORITY_VIEW - talent management -> basic settings -> search
2. Schedule program RPTMC_CREATE_CHANGEPOINT_AUTH - every 30 mins, or 1 or 2 hr. This program will capture whenever anything changes from an authorization data perspective. This would include identifiying new central persons (new hires) or new TMC specialist being setup with 741 relationship. This program "creates change pointers" which than feeds the main delta program - ESH_IX_PROCESS_CHANGE_POINTERS.
3. Use Luke's blog on the instructions for the delta program - ESH_IX_PROCESS_CHANGE_POINTERS - this program you can have run every 5 mins, 10 mins, 15 mins, based on your needs. this processes all delta changes, the first time the program runs after the RPTMC_CREATE_CHANGEPOINT_AUTH program finishes it will also processes the data authorization changes, otherwise every other time the program is running it will catch non-data authorization for all the other indexes (employee name change, new performance rating, new potential, position name change, new profiiciency scale, new career profile data, etc).
hope this helps somebody!
michael
Edited by: Michael L Pappis on Oct 7, 2010 12:05 AM

How to configure one TREX host with multiple index servers ?

Hi All,
Does anyone know how to configure TREX on the one host,
with multiple index servers ?
Reason for this is to make better use of resources available on the host server(4 Gig, 4 Processor, Windows2003), to improve the search performance of
our KM content for portal users.
I am using TREX 7 and have not been able to do this,
despite reading the Single and Distributed install
documentation.
Any help would be appreciated.
Regards,
Andres

Hi Andres,
To make use of the RAM a Server provides you have to run two indexserver processes (each can then consume 2 GB);
Proceed like this:
1. Go to TREXdeamon.ini; check if section [indexserver2] is there (it is already provided, but not active in standard installation)
2. In TREXdeamon.ini go to
[daemon]
references sections below
programs=nameserver,preprocessor1,indexserver1,queueserver,alertserver
and add indexserver2 here. Restart TREX; second porcess is then started; can be checked in TREX monitor in Portal as well
3. To distribute existing indexes to the new process, start TREXadmintool and go to Index: Landscape
Go to the last two columns and move the indexes (move master here/secondary mouse click)
If you don't distribute the indexes the new index server process will be regarded when an new index is created.
Hope this helps!
cheers
Bettina

TREX 7.0 - moving index / queue folders to new installation

Hi,
I have a TREX 7.0 instance, I want to move it and also change the SID. Can I just install a new TREX instance and then copy the queue and index folders to the new instance? Or do I need to copy the whole TREX directory? Can I still do this if the SID is changing?
Many thanks
Jane

Hi Jane,
I read, you have a TREX 7.0 Instance.
Do you have this Instance on a extra machin? maybe OS Win 64Bit?
best regards
K

TREX: getServer failed for index

In the portal TREX monitorName I see I have 2 nameserver available with green status:
Host Service
devportal:30501 Available
<nameserverhost2>:0 Available
Is this OK?
Indexing doesn't start. In the queue server log I see:
[00023] 2006-04-03 09:49:18.396 e CLIENT_TRACE TRexApiAdmin.cpp(04284) : TNS: getServer failed for index 'index01', function: 'getAttributeList'
[00023] 2006-04-03 09:49:18.400 e CLIENT_TRACE TRexApiAdmin.cpp(04364) : Index does not exist;index=index01 : return code: 2007
[00001] 2006-04-03 10:58:58.278 e TrexNet Channel.cpp(00230) : ERROR: reading from 3 <193.43.73.23:30501> failed with rc=14 (connection broken)
[00001] 2006-04-03 10:58:58.285 e TrexNet BufferedIO.cpp(00440) : ERROR: read from 3 <193.43.73.23:30501> failed - resetting buffer
[00001] 2006-04-03 10:58:58.286 e TNS TNSClient.cpp(00448) : sendRequest to devportal:30501 failed with NetException. data=[setinactive](S)client_id=devportal:30504.21657-1|...
Thanks guys..
Davide

Hello Rao,
yes, there is a workaround to solve this. Basically you should explicitly specify a System ID for the IndexManagementTaskQueueReader task.
Surf to System Administration -> System Configuration -> Knowledge Management -> Content Management -> Global Services -> Scheduler Tasks. Click on the Index Management Task Queue Reader, and assign the correct CM System(s).
Have a look to these threads for more info:
No crawler tasks? EP6 SPS16 Patch 2
Configuration Error: No CM system assigned to this task.
Cheers, Davide

Error while creating index on ep 6.0 9 sr1 (trex 6.1).

Hell o all,
I am getting following error while creating index on ep 6.0 9 sr1 (trex 6.1).
Index could not be created; creating index failed: general configuration error (Errorcode 2030)
can any on ehelp.
thanks and regards
Rajendra

Hi,
We are running TREX 6.1.09.00 on EP6.0.9.0.0 and KMC6.0.9.0.0.
We are experiencing the same problems, even after changing the value in the .ini file as specified in NOTE 766197.
After doing changes, I restarted the server after doing the changes.
Alessandro, have you got any ideas for fixing this?
Message was edited by: Bjorn Bjornstad

TREX doesn't index some PDF documents ...

Hello all,
we have installed EP'04s and TREX ver. 7.00.42.00. It works well except one thing. TREX is not able to index some PDF documents. Most of them is indexed correctly but some documents not. Actually the problematic PDF documents are indexed but their content is not. In search result is displayed message "No document excerpt available" for the documents.
I found SAP Note 622419 that could relate with that but I don't know how can I check:
1. What encoding was used in particular PDF form.
2. What fonts or what font types were used in particular PDF form.
Do you have any idea how to find out these information about a document? Or do you know where could be problem when TREX are able to index content of just some PDF documents?
Regards,
Zbynek

Thank you, that was what I needed.
So now I know the test PDF document use only TrueType fonts. That means its content should be indexable for TREX but it isn't. There is just message "No document excerpt available" for this document in search results.
Could someone look at the document and try to index it? It can be downloaded from http://www.volny.cz/kabrtz/TREX/indexing_test.pdf
Regards,
Zbynek

Using TREX to index R3(WAS) tables

Hi,
I am developing a bsp application on WAS 6.40 and I will like to know if there is a way to use TREX in order to index table contents. Of course, I need also a way to use TREX for searching. Can anyone help?

Hi,
I order to have a quicker response, I think you should post this question in KM forum.
Meanwhile, have a look at things like
http://help.sap.com/saphelp_nw04/helpdata/en/22/89ab46e2674648aec9c0c7c0c040b0/frameset.htm
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/81c1ca90-0201-0010-a2a1-b0412ec9cd1a
and https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/ec4ee290-0201-0010-6c8d-98db9abff2cc
Eddy

TREX Indexing

Hi everyone!
Does anyone ever experienced problems with TREX indexing after installing SES?
In my project i've just setup SES and strangly Attached files are still being indexed on the old index queues and when i search for the content of the files using the TRM search it doesn't return the expected results.
Many thanks.

Hi Reddy,
TREX Queue maintains both index and deindex call entires.
Since you have deleted the ABC folder with 10 documents, it also has the deindex count of 10 .
This is the reason why you have 22 indexed documents plus the previous 10 deindexed documents.
You can check this by display queue entries and check for all synchronized documents.
Regards,
Srini

TREX indexing public website

Hi,
Is there a way for me to feed our company's intranet/internet URL into TREX and let it crawl through all the links beneath? If not, is there any workaround for this scenario?
Thanks,
Michael

hi Michael,
It is possible...
First create Webaddress.. Goto Sys.admin> Sys. Config> Knowledge Management > Content Management> Repository Manager> WebAddress> Give Http Url as eg, www.yahoo.com..
After some times, it wil comes under KMContent>www> some file wil create here in the name of yahoo. (assign this as index datasource)
do u know how to create TREX.. while creating select service as TREX Serach
Create index.. assign yahoofile under www as datasouce..
regards,
Chinnadurai R

Trex: Indexing a document link.

Hi everybody,
I am trying to index some document links in my portal but TREX seems not to index. I have a folder with some documents and another folder with links to this documents. The documents have some properties and the links have a diferent type of properties. What I need is to create a taxonomy with the links classified using some of theri properties (not the document properties). When I index the link folder, the crawler return all the files but when I watch the index queue everything is at 0, no file is being proccessed.
Thanks in advance.
Gregori Coll Ingles.

Gregori,
what is the start condition of your indexes?
http://help.sap.com/saphelp_nw2004s/helpdata/en/71/090e41bb0ff023e10000000a155106/frameset.htm
James

BIA Rev. 7.00.53.00, DBMAN 305, RSD_TREX 100, unloading temp indexes...

Hi BIA team,
we have several questions regarding some error situations which we get when we execute many parallel queries against the BIA.
On BI side we get this 2 errors:
DBMAN 305 Error reading the data of InfoProvider YREP_BC_1$X YREP_BC_1$X
RSD_TREX 100 Error executing physical plan: general error (no f 2999
On BIA side in the TrexRFCServerAlert trace at the same time we found this type of errors:
1. TREXRfcSvr   trexAggregate.cpp(01016) : TREX_RFC_AGGREGATE_SP5 rc: 2999 (Error executing physical plan: general error (no further information available);BwPopBuildIndexUnion pop29(setAliasIndex('pcs_yrep_bc_1-union_of_pcs_bi0_0805006369_pcs_bi0_0805006377en'),addIndexForUnion('pcs_bi0:0805006369en'),addIndexForUnion('pcs_bi0:0805006377en')),in executor::Executor in cube: pcs_yrep_bc_1).
2. TREXRfcSvr   trexAggregate.cpp(01016) : TREX_RFC_AGGREGATE_SP5 rc: 2007 (Error creating physical plan: Index does not exist;index=pcs_bi0:0805095572 in cube: pcs_yrep_bc_1).
We have observed that this types of errors are present if the BIA has the overloaded warning and unloading temp. indexes...
Now the Questions:
1. Why is BIA unloading indexes which are needed for the current query execution, why not deleting only old ones ?
2. After 10000 query executions we have about 22000 temp indexes and in the Reorg tab there is a warning "Standard Deviation of Join/OLAP Indexes 10147 MB, 1625 MB, 84 %, reorg yes", should we schedule a daily job for the cleanup ?
5. What exactly does "Standard Deviation of Join/OLAP Indexes" in BIA world mean ?
3. Were are the temp indexes stored, Shared Memory ?
4. Currently we have phys. 284 GB Ram and 95 MB shared memory assigned, what would be the ideal value for Shared Memory ?
Thanks a lot in advance!
Roman Doubrava

I believe you can dismiss the reorg message, it should take care of itself.
Make sure your BW statistics are running regularly, lack of it may contribute to this.
Looks like you need more memory ( by deleting data or adding blades). Before than I would do a reorg and re-start BWA to clean up temp indexes -there is one memory for data and temp indexes -.
I would check if you have APD queries and definitely exclude them from BWA.
If none works, I would check the statistics for the last 90 days to see what cubes and what queries went to BWA and how many times. Based on the facts that you can either eliminate the least used cubes, based on the nr of recordes being fetched you can exclude certain queries from BWA maybe schedule them overnight, you can exclude BATCH/Information Broadcasting queries, user aleremote, etc
Cheers
Tansu

How to display the index generated by TREX?

We have a need to display the indexes generate by TREX for SM7.0 KM and EP7.0 KM.
Please help tell how to do it?
Thanks a lot!

Hi Ashley jo,
Well, the above would not help in OS level.
The Design is, TREX always stores the indexed pointers to the actual data in it's database rather OS level.
But at OS level, you can find details about how TREX has been configured and managed.
The typical path would be <Drive>:\usr\sap\<SID>\TRX<Instance number>\<Host name>
In this path, you find all *.ini files which contains the configuration details apart from regular 'work', 'log', 'trace' directories.
Regards
Sekhar

EREC: TREX Index status

When i go to SES_ADMIN, if the objects dont have anything to index since the time system is online, will the status always be Initial?

Hello Dhana,
for the latest eRec releases in combination with TREX 7.10 the index category is no longer used. So this is not an issue.
If you think that some configuration steps are missing you should repeat the eRec TREX setting again. I assume you are using an up to date eRec release (enhancement package and support package stack) so check SAP note 1301016 in the service marketplace. There you find 3 scenarios, pick the one which is matching your system and repeat all steps.
Within the note you also find the names of the eRec indexes.
Kind Regards
Roman
PS: one small hint for configuring the indexes in SES_ADMIN. The note still says that you first add the object and then the relation indexes for objects ERC_CAND/NA and that an error message appears. This has changed since some support package. Object and relation indexes are created together.

TREX Alerts on unloaded indexes

Similar Messages

Maybe you are looking for