Force Crawler in Maint Mode to Ignore Last Modified Data and Re-Index All

We are running SES 10.1.8.4 with the Siebel 7.8 data source patches 8533402 and 8624308 to index documents (PDF, XLS, DOC, PPT) via RMI and Decompression Tool in Siebel. This data source is virtually identical to the database data source.
The crawler will not "fail" if the actual indexing of the attachment file itself fails. For example, if RMI is down on the Siebel server and the crawler runs, SES will index the document metadata returned in the SQL but not the document. If the client then starts the RMI utility and re-runs the crawler, the document that was not indexed will not be re-indexed because the data source's last crawl time is used against the data sources last modified date attribute.
Here is the pseudo SQL for the initial crawler query in maintenance mode....
SELECT .... FROM MY_VIEW WHERE LASTMODIFIEDATE > TIME OF LAST DATA SOURCE CRAWL
We have found a way to update the data source's last crawl time (DS_LAST_CRAWL) in the EQ$_DATA_SOURCE table. For now, we simply are using SYSDATE - 1.
This will allow the missed document to be returned in the initial query.
However, it's the crawler's document-level last modified date check within the crawler that is preventing the re-index. Since the document's last modified date is the same as what SES has, SES skips over it thinking it has not changed. True, it has not changed but it was missed during the last re-crawl and we want it to be indexed again.
The client does NOT want to perform a full re-index because of the anticipated volume of attachments.
Is there any way to tell the crawler to ignore the document-level last modified date and re-index everything returned from the initial query? Perhaps one of the other columns in the EQ$_DATA_SOURCE (DS_STATUS, DS_CRAWLING_MODE) holds the key?
Thanks!

I think it might be possible to set ENQUEUE_STATUS = 'Y' in the table EQ_TEST.EQ$URL. You may need to call eq_adm.use_instance(1) before doing so.
However I'm not sure of the full implications of doing this - DON'T DO IT ON A PRODUCTION SYSTEM without carefully testing on a development system.

Similar Messages

  • How to get last modified date and time of a file which is in apache server.

    Hi ,
    I need to get last modified date and time of a file in remote machine.
    This file is in remote machine which has apache server installed.
    I am trying to get this information by connecting to apache server from client by giving absolute URI of the file to file object.
    URI is got from apache server URL by using toURI method.
    when I use lastModified method , its throwing exception , because scheme of URI is not file.
    I can't give scheme as file because ftp server is not installed on that server
    Is there any other way to get this information .

    No, unless you can use an FTP client.

  • How to find the Last modified date and time of a package

    Hi,
    We need a clarification on how to find the Last modified date and time of a package in Oracle. We used the example below to explain our scenario,
    Lets consider the following example
    Let A, B be two packages.
    Package A calls the package B. So A is dependent on B.
    When A is compiled the TIMESTAMP,LAST_DDL_TIME in USER_OBJECTS gets updated.
    Now there a modification in package B so it is compiled. There is no modification in package A.
    Now when the package A is executed the TIMESTAMP,LAST_DDL_TIME in USER_OBJECTS gets updated but we did not make any change in Package A. Now we need to find last modified date and time of the package A . So we can not rely on the TIMESTAMP,LAST_DDL_TIME in USER_OBJECTS . Can u please tell us any other solution to get last modified date and time of the package A .
    Regards,
    Vijayanand.C

    Here is an example:
    SQL> SELECT OBJECT_NAME,CREATED,LAST_DDL_TIME,TIMESTAMP,STATUS FROM USER_OBJECTS
    2 WHERE OBJECT_NAME = ANY('A','B');
    OBJECT_NAM CREATED LAST_DDL_TIME TIMESTAMP STATUS
    A 20-MAY-2004 10:57:32 20-MAY-2004 10:57:32 2004-05-20:10:57:32 VALID
    B 20-MAY-2004 10:58:22 20-MAY-2004 10:59:04 2004-05-20:10:59:04 VALID
    SQL> CREATE OR REPLACE PROCEDURE A AS
    2 BEGIN
    3 NULL;
    4 NULL;
    5 END;
    6 /
    Procedure created.
    SQL> SELECT OBJECT_NAME,CREATED,LAST_DDL_TIME,TIMESTAMP,STATUS FROM USER_OBJECTS
    2 WHERE OBJECT_NAME = ANY('A','B');
    OBJECT_NAM CREATED LAST_DDL_TIME TIMESTAMP STATUS
    A 20-MAY-2004 10:57:32 20-MAY-2004 11:01:28 2004-05-20:11:01:28 VALID
    B 20-MAY-2004 10:58:22 20-MAY-2004 10:59:04 2004-05-20:10:59:04 INVALID
    SQL> EXEC B
    PL/SQL procedure successfully completed.
    SQL> SELECT OBJECT_NAME,CREATED,LAST_DDL_TIME,TIMESTAMP,STATUS FROM USER_OBJECTS
    2 WHERE OBJECT_NAME = ANY('A','B');
    OBJECT_NAM CREATED LAST_DDL_TIME TIMESTAMP STATUS
    A 20-MAY-2004 10:57:32 20-MAY-2004 11:01:28 2004-05-20:11:01:28 VALID
    B 20-MAY-2004 10:58:22 20-MAY-2004 11:01:53 2004-05-20:11:01:53 VALID
    Note that the date under the column 'created' only changes when you really create or replace the procedure.
    Hence you can use the column 'created' of 'user_objects'.

  • Reportable Last Modified Date and Time Field

    Reportable Last Modified Date and Time Field
    Hello,
      We need a reportable RequestCenter 'last modified date/time' database field that is refreshed when the 'Comments and History' field is updated.  Any ideas would be appreciated.  Thanks! 

    No, unless you can use an FTP client.

  • Get last modified date and time of sharepoint site through Search

    Hi All,
    I am trying to get the last updated date and time of a sharepoint site using KeywordQuery.
    For this I updated an existing list item, added a new item in a site and crawled the content. Then I used "ContentClass:STS_Site" as query in C# code to fetch the search results. I am able to get most of the properties I require for that
    site. However "LastModifiedTime" does not return the correct value. It returns an older value.
    How can I get the last updated date of a sharepoint site using search ?
    Regards,
    Vipul Kelkar

    No, unless you can use an FTP client.

  • Getting last login dates and times for graphical/xwindows logins?

    Hi,
    How do I get the last login date and times for users who just use the GUI (and don't launch terminals)?
    So far such logins don't seem to show up when I do "last -f /var/adm/utmpx" or for wtmpx.
    What should I be using on solaris to get the last login dates and times for all users, whether they log in on the text console, graphical console, or remotely via ssh etc?
    Thanks,
    Link.

    Hi,
    How do I get the last login date and times for users who just use the GUI (and don't launch terminals)?
    So far such logins don't seem to show up when I do "last -f /var/adm/utmpx" or for wtmpx.
    What should I be using on solaris to get the last login dates and times for all users, whether they log in on the text console, graphical console, or remotely via ssh etc?
    Thanks,
    Link.

  • Getting the last modified date of the contact in addressbook

    Hi all,
    Is there any way to get the last modified date and created date of the contacts stored in address book . I have gone through the api docs and could nt find any api's to get the modified date of the particular contact .
    Any help would be greatly appreciated ..
    Regards,
    Mohammed Sadiq.

    Hi,
    Is the above feauture available in AddressBook fraamework ?
    Best Regards,
    Mohammed Sadiq

  • Know an extension that searches for the file "last modified" date?

    I am working on a site with 80,000 pages and need to find an
    extension that will search all files within the site and populate
    the date each file was last modified. Know of an extension that
    will assist in this situation? Any ideas will help, thanks in
    advance!

    Ahh, so now your requirements are changing. You do not want a
    simple
    text file output after all, but instead a sortable list. So
    perhaps
    output as a csv that could be sorted within a spreadsheet.
    Altho 80000
    rows?
    It is a bit hard to believe that an organization with an
    80000 page
    website does not have inhouse gurus who could do this in a
    heart beat.
    E. Michael Brandt
    www.divaHTML.com
    divaGPS | divaFAQ
    www.valleywebdesigns.com
    JustSo PictureWindow
    mercuryfenix wrote:
    > I just finished the first scan and was not impressed.
    PageList creates an ugly
    > and nearly useless list of file name, title, path from
    page root, a link to the
    > file, last modified date and time, and some meta
    garbage. To top it all off,
    > you cannot sort it by any of these categories because it
    puts all the data into
    > a lousy html table- useless.
    > I could probably get buy with this, but it would be
    horrible....80,000 pages
    > to scan! O yeah, i forgot to mention it has a very low
    limit to how many files
    > it can scan in one scan!
    >
    > I still am in need of a better extension. Please keep
    helping.
    >

  • SharePoint 2007 Site Last Modified date issue

    Hello,
    Good Morning.
    We are facing Last modified date update issue in MOSS 2007. From last 2 days, In All site content the site last modified date is displayed as 3 month ago but actually the site was last updated by more than 2 year ago.
    Could you please help on how to resolve this issue.
    Thanks in advance.
    -Tushar

    Hi,
    From your description, you think last modified date of your Moss 2007 site is wrong.
    Could you offer a screenshot about your All site content page?
    You can use the LastItemModifiedDate property of the Web object to get the last modified date of your site:
    https://social.msdn.microsoft.com/Forums/sharepoint/en-US/2c74a56b-18b6-4dc9-b368-b96dcf7be3ec/last-modified-date-and-time-in-sharepoint-site
    https://farhanfaiz.wordpress.com/2010/03/22/sharepoint-2007-last-modified-date-of-lists-document-libraries/
    Best Regards,
    Lisa Chen
    TechNet Community Support
    Please remember to mark the replies as answers if they help, and unmark the answers if they provide no help. If you have feedback for TechNet Support, contact
    [email protected]

  • Search results not displaying correct last modified date

    Hello
    I have a bit of a strange issue.  I have a SharePoint site that was upgraded from SP2010 to SP2013.  A document has been created and uploaded into SharePoint on 1 August 2014 and the file has since been edited.  In the search results the last
    modified date is appearing as '8 January'.  Note that this document was not originally created from a blank one but was instead a Word document that was received by the user and then edited and then uploaded into SharePoint.
    I have checked my locale settings and everything is set to New Zealand.
    I have rerun a full crawl on my search database and this hasn't helped.
    Also, I have multiple sharepoint web applications on my server using the same search service application.  is it best to separate these out?

    Hi Martin,
    As I understand, the issue you encountered is the LastModifiedTime displayed incorrect in search result.
    If you go to CA > Search service application > Search schema, in Managed Properties, type LastModifiedTime, then you will get LastModifiedTime property. Click it and you will find the property is mapped to five crawled properties.
    I’d recommend you create a new managed property and only map it to ows_modified property. Then test the issue again.
    http://spvee.wordpress.com/2013/10/09/content-search-web-part-cswp-sort-by-modified-datetime/
    Regards,
    Rebecca Tu
    TechNet Community Support

  • Redo Log Last modified date

    Hi All,
    Couple of day's back we have set Hot back up mode for 11g database server from cold back up,
    after this reado log's last modified date is not getting updated and redolog last modified date is get's updated only when we restart the database,
    There is no error message in the alert log and data base running normally without any issues,
    can you please advise me why redo logs LastModified date is not getting updated.
    Thanks
    sankar

    user12994238 wrote:
    Hi All,
    Couple of day's back we have set Hot back up mode for 11g database server from cold back up,
    after this reado log's last modified date is not getting updated and redolog last modified date is get's updated only when we restart the database,
    There is no error message in the alert log and data base running normally without any issues,
    can you please advise me why redo logs LastModified date is not getting updated.
    Thanks
    sankarcould it be that the timestamp is not updated until such time as the file is closed? That would be easy enough to observe/test.

  • Automatically (programming) Extracting last modified date

    Hi
    I have the url addresses of sesveral documents stored in SharePoint.  Those addresses are stored in a column within Excel.  There is one address per line (row).
    I would like to extract for each file its last modified date.  Ideally in an automatiic mode.
    All files are not in the same "folder".
    How could I achieve that?
    Many thanks in advance

    Hi,
    you can write a query to get all the files from the doc library and use SPFile.Properties to get the last modified date
    http://msdn.microsoft.com/en-us/library/microsoft.sharepoint.spfile.properties.aspx
    your code will be like the below (Taken from above link)
    SPSite oSiteCollection = SPContext.Current.Site;
    using(SPWeb oWebsite = oSiteCollection.AllWebs["Site_Name"])
    SPFolder oFolder = oWebsite.Folders["Shared Documents"];
    SPFileCollection collFiles = folder.Files;
    foreach (SPFile oFile in collFiles)
    System.Collections.Hashtable collHashes = file.Properties;
    System.Collections.ICollection collKeys = hash.Keys;
    foreach (object oKey in collKeys)
    Response.Write(SPEncode.HtmlEncode(oKey.ToString())
    + " :: " +
    SPEncode.HtmlEncode(hash[oKey.ToString()].ToString())
    + "<BR>");
    another option would be to use SPFile.TimeLastModified
    http://msdn.microsoft.com/en-us/library/microsoft.sharepoint.spfile.timelastmodified.aspx
    http://msdn.microsoft.com/en-us/library/microsoft.sharepoint.spfile_properties.aspx
    Hope this helps!
    Ram - SharePoint Architect
    Blog - SharePointDeveloper.in
    Please vote or mark your question answered, if my reply helps you

  • How can you find the Last Modified Date of a particular table

    Hi,
    I want to show to the LAST MODIFIED date of a particular table to the user before refreshing the table with new data. Experts please suggest me the way using JDBC-SQL connection.

    There is no generic SQL way for this. It depends completely on the features your DBMS offers. With Oracle you'd need to create column which gets updated in a trigger. I believe MS SQL Server offers a special data type for this, which is updated automatically. I don't know about others.

  • No dates in Last Modified Date or Added Date

    Hello.
    Due to some issues with our servers i'm unable to make any SR's so i hope to recive some answers here instead while that issue gets resolved.
    When looking in the colums "Added Date" and "Last Modified Date" certain activites have no dates there. When attempting to filter all the activities with a filter "Added Date Equals 'Blank' " ie all aktivites who do not have a date in Added Date, the results are 0 activites. I interpret this as the fields are not empty but for some reason the information is not displayed.

    781070 wrote:
    Hello.
    Due to some issues with our servers i'm unable to make any SR's so i hope to recive some answers here instead while that issue gets resolved.
    When looking in the colums "Added Date" and "Last Modified Date" certain activites have no dates there. When attempting to filter all the activities with a filter "Added Date Equals 'Blank' " ie all aktivites who do not have a date in Added Date, the results are 0 activites. I interpret this as the fields are not empty but for some reason the information is not displayed.As far back as I can remember, filtering by either of those fields has never worked.
    There are a number of reasons why the last modified or added date could be blank.

  • My last computer crashed and it had all my songs and i got a new ipod how do i get those songs back

    ok so my last computer crashed and it had all my songs and that day i got a new ipod how do i get those songs back thast i paid for?

    If the songs are not on an iPod or a computer (didn't you have a backup of your computer files?) you are probably out of luck since you only get one download of music from the iTunes store and it is up to you to back them up.  However, the Itunes store may allow a redownload if you explain what happened.  Go to the following and select the appropriate topic to contact them.
    Apple - Support - iTunes

Maybe you are looking for

  • Connecting ipad2 to TV

    I would like to connect my ipad2 to my TV in order to watch BBC iplayer on a larger screen with more volume. I have asked a couple of people in shops and received different answers. My TV is a small and very ordinary Samsung but it has an HDMI socket

  • Special Charges in SD invoice

    Hi, My client is a distributor in US. We are using vertex, how do u handle special charges like Small Order Charge and handling charge or fuel surcharge. Do I need to use the user exit to send these different charges. thanks

  • Heterogeneous Connectivity to Mysql

    Hi Fellows. I need to connect to a Mysql Database online from Oracle 10G (Create a link) I read some article regarding Heterogeneous Connectivity to other non Oracle Databases without ODBC or DNS. Does anybody has deploy this Oracle feature???? Does

  • Regarding 'BAPI_PRODORDCONF_CREATE_TT'

    hi experts,                do u have code sample for confirming production order with the help of bapi 'BAPI_PRODORDCONF_CREATE_TT',,,from where we will get confirmation number to pass in this FM....PLZ explain in your words........which are the comp

  • Flash 8 to flash 6

    C title all i want to do is turn a flash 8 file in to a flash 6 file, WHY COURSEWORK. I kind of need to find out how before december Adobe i hate u