What are Crawlers(Task/Process) and how they take part during indexing

Hi,
I'm new to TREX search Engine. i want to know that what are Crawlers task and how & when they perform their duties after the DataSource is assigned to a newly created index. I mean to say, how they are closely related to search indexes.
Regards
Nitin Mishra

hi,
The crawler only searches Web sites or parts of Web sites that are not protected by robot instructions. Robot instructions are part of Internet standards. They allow Web site owners to permit or forbid the crawling of their sites or parts thereof
Depending on the type of repository, you may have to set up a crawler and a schedule.
       For Web repositories, the index is updated using a crawler. If you are assigning a Web repository to an index for the first time, it is indexed immediately. You then need to regularly schedule the crawler so that the index is updated. 
      For hierarchical repositories, the index is updated by using events. Therefore, it is not absolutely necessary that the crawler be started at regular intervals. However, you can start the crawler at regular intervals in order to make changes in the index for which no event is triggered. This can be the case if documents have been created, changed, or deleted directly in the file system without using Knowledge Management.
Regards,
Ganesh N

Similar Messages

  • Activity monitor - what are all these processes and how do i stop them?

    hi.
    i have a laptop that i use completely for live music performance and i want to disable everything on the mac that could be taking up RAM and CPU power.
    i firstly notice airport base station agent and spotlight. can i disable these?
    i also notice itunes helper... whats that?
    i also have lots of others such as - ATSServer, launchd, loginwindow, mdworker, pboard, syncserver, systemUIServer and UserEventAgent... what are these and do i need them running?
    many thanks....

    hi.
    thanks for coming back with an answer so quickly.
    in activity monitor i can see spotlight is taking up about 25mb.
    i have a 6GB music session to run with a huge CPU load so every bit of my 4GB RAM is taken up.
    i do use spotlight a lot but could do without if it meant freeing up a little bit of space... it all helps!
    i can see no page outs and it says 0 bytes but even though im running nothing on my computer i only have 3.3GB of my 4 available. 260MB is active and 420MB is wired.
    im sure ableton live (my live music app) would appreciate even a little bit more RAM...
    i know the maximum RAM my mac can have is 4GB but i think thats the limit for the application anyway so buying a new mac and more RAM wouldnt help i dont think....
    any ideas?

  • What are user parameters? and how can i add user parameter

    Hi Experts,
    what are user parameters? and how can i add user parameter and how can i add a user parameter
    HR_DISP_INFTY_NUM with value X?

    user parameters are used give reference grps and counntry grouping use SU3 tcode as amite said

  • What are unicode code points and how many are there and which are surrogate

    what are unicode code points and how many are there and which are surrogate

    Hi
    see the links
    The Link will be helpful to you.
    Re: Upgrade 4.6 to ECC - What are the responsibilites
    regarding Unicode influence in Standard programs
    Very good document:
    http://www.doag.org/pub/docs/sig/sap/2004-03/Buhlinger_Maxi_Version.pdf
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/d37d1ad9-0b01-0010-ed9f-bc3222312dd8
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/589d18d9-0b01-0010-ac8a-8a22852061a2
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/f8e316d9-0b01-0010-8e95-829a58c1511a
    Reward points for useful Answers
    Regards
    Anji

  • What are these shared computers and how do I remove them from Finder?

    I have four Macs on my closed, hidden wifi network. Two iMacs and Two macbooks. For some reason, two unknown computers are showing up on the network, but only on two out of the four macs, one imac and one macbook, incedentally the two units with built in SD card readers. They are: hp0025b3e8a8ca and hp3c4a921329ca. I'll post a screen shot. They both have one folder called MEMORY_CARD and I can't open it. I've double checked, I don't have SMB sharing enabled on any of my macs. They have the little icon associated with a windows machine. Any idea what these are and how I can remove them from finder? is someone else on my network?

    How are u connected, as in ISP, University Network, etc.? I get shares like that too, as my ISP here in Nepal is using some crazy way of sharing connections with customers. I called and asked them once, but they have not clue about Macs. I suspect it's a technician doing some work in the office, who is tapped into the same C1 connection that I am using, but it is a bit disconcerting to see computers you don't know on your Network.
    When I teach in Thailand, I am on a university system that will show all the users connected to the same hotspot. That's why I lock down my sharing when there. It's kinda crazy, as I don't really understand all the security settings and what they imply. It would be nice if there were a guide for home/small business Lans on what exactly the settings should be in OSX, but I suppose it's all out there in Google, somewhere...

  • What are these imports?and how can i use them?

    import javax.microedition.lcdui.Canvas;
    import javax.microedition.lcdui.Display;
    import javax.microedition.lcdui.Form;
    import javax.microedition.lcdui.Graphics;
    import javax.microedition.lcdui.Image;
    what are these imports?

    how would i make a server applet that can be accesed by 2 specific pll or random which ever makes it easier for the time being i just want 2 ppl to have acces to one applet and have a variable like a paddle in pong under each persons controll

  • What are these random files and how do i stop them?

    I just bought my macbook pro about a month ago so I'm new to it. But recently, Ive noticed that randome movie files and pictures have been showing up under the "all documents" button in finder. Some of these pictures I recognize from photobooth, but they were taken on a different computer way before i even purchased this one. And other files like the movie files and some of the pictures are completely random and I've never seen them before. The movie files are short 10 sec films and the photos are just photos. anyone have a clue on whats going on here?

    How are u connected, as in ISP, University Network, etc.? I get shares like that too, as my ISP here in Nepal is using some crazy way of sharing connections with customers. I called and asked them once, but they have not clue about Macs. I suspect it's a technician doing some work in the office, who is tapped into the same C1 connection that I am using, but it is a bit disconcerting to see computers you don't know on your Network.
    When I teach in Thailand, I am on a university system that will show all the users connected to the same hotspot. That's why I lock down my sharing when there. It's kinda crazy, as I don't really understand all the security settings and what they imply. It would be nice if there were a guide for home/small business Lans on what exactly the settings should be in OSX, but I suppose it's all out there in Google, somewhere...

  • In FF (30.0) Password Manager, when you open Edit, what are all the fields and how do you fill them in?

    When you open Edit, there are two choices: Web form and annotated.
    What is the difference?
    Then, there are fields for Host, Submit Prefix, Username, Password, etc.
    How do you fill in these fields?
    When you click to have the manager "Guess from Current Page," all fields don't necessarily get filled in, so is it just for username and password?
    I use the edit feature constantly, so it's a little odd not to see more detailed instructions here.
    When I click on Tools, the Saved Password Dialog is on the list, so it's on my toolbar all the time.
    I use it constantly.
    What is the latest in password security? I know there are competing ideas. What does Mozilla think?
    Thank you.

    Hmm, could this be a feature of your extension, "Saved Password Editor"? The support article ([[Password manager - Remember, delete and change saved passwords in Firefox]]) doesn't show those changes when I switch the version from 29 to 30 in the left column.

  • What are the various toolbars and how do I restore a missing one?

    The toolbar (I THINK it's a toolbar) that usually appears at the top of my Safari page has disappeared. It's the one that offers new windows, etc. I don't know what it's called or how to get it back -- or why it disappeared in the first place. I know someone can help and I thank you in advance.

    Click "View"menu  in the Safari menubar and select "Show Toolbar".
    or
    Click "View" menu in the Safari menu bar and click "Customize Toolbar".
    From the drop down drag the default set into the Toolbar.
      the one under " or drag the default set into the Toolbar"
    Click "Done".
    Best.

  • Some bookmarks have "grown" a suffix of 3 characters âЄ . The bookmarks still work. What are these nutty suffixes and how do I remove them? Many have been "infected"?

    These suffixes are unwanted and have infected all my browsers Firefox and IE9. Some bookmarks are unaffected. This also happened on my previous PC running Windows Vista and IE8. I edited all the affected bookmarks to remove the suffixes, but now they're back.

    Upgrade your browser to Firefox ab and check
    * getfirefox.com

  • What is the meaing of the sysmbolic constant value in the header file for UIR file and how they are used

    In labwindows after creating the uir then header file is create automatically. There it has define some symbolic constant. As examples of colview.h(from the examples of labwindows )
    #define  MAINPNL              1       /* callback function: MainPanelCB */
    #define  MAINPNL_RESULTS      2     /* control type: table, callback function: ResultTableCB */
    #define  MAINPNL_NEWTEST     3       /* control type: command, callback function: NewTestCB */
    My question is how these values 1, 2 and 3  were selected and how they are used in programs ?
    If anyone explains, it will be a great help.

    When creating a UIR file, CVI editor takes care of assigning constants to the panels / controls you create in it.
    The conceptual framework is the following (assuming to treat the file you have reported in your message):
    - Within a single UIR file all panels have a unique ID, which is the one you pass to LoadPanel when loading a panel into memory. LoadPanel (0, "myfile.uir", MAINPNL); is then translated to panelHandle = LoadPanel (0, "myfile.uir", 1); , that is: "load the first panel in the uir file". The panel in memory is then assigned a handle, which is guaranted unique by the OS and saved in panelHandle variable
    - Addressing a control in a panel is done e.g. using SetCtrlVal (panelHandle, MAINPNL_NEWTEST, xxx);  , which again is translated to SetCtrlVal (panelHandle, 1, 3);  that is: "Set control #3 in the panel identified by panelHandle to value xxx".
    You must not modify the include file associated to the UIR as it is fully maintained by the IDE and is rewritten each time you save the UIR file.
    That conceptual framework has some advantages and some caveats:
    - You can load the same panel more then once in your program: each instance is independent from the others as each panel handle is unique; in some occasions it may be helpful, e.g. if you need to handle several identical equipments connected to your PC and you can load the same control panel for each unit connected maintaining each of them independent
    - If the panel handle is wrong, the system does not warn you of this as it does not know of the symbolic names you are using; if you try that SetCtrlVal command with a wrong handle you are trying to manipulate a control on a panel different from the one you intend: supposing actual panel idientified by the handle has control #3 the maximum you can expect is that you receive an error in case you pass e.g. a string to a numeric, but if controls are of the same type you have no errors or warning at all! This is particularly important when addressing controls on pages of a tab control: each page is really a separate panel with its proper handle that you must retrieve with GetPanelhandleFromTabPage command before addressing the controls on it
    Proud to use LW/CVI from 3.1 on.
    My contributions to the Developer Zone Community
    If I have helped you, why not giving me a kudos?

  • I was able finally to delete unwanted text boxes in my document; however, now my second page is missing and there are several following pages in a language that appears to be Latin.  What sin have I committed and how do I atone to get my second page back?

    I was able finally to delete unwanted text boxes in my Pages document; howver, the result is that the 2nd page of my document is missing and there are now several following pages in a language that appears to be latin.  What sin have I committed and how do I atone?

    10 marks for recognising the Latin (sort of) that is the placeholder text in your template.
    You are using a Word Processing template. WP templates have content flowing from page to page. As one page fills up, a new one is created. If some of that text is deleted or displaced the pages retract.
    When you combine text, invisibles like word spaces, returns, tabs, page breaks etc with objects that have text wrap set, the mix can behave in an apparent odd fashion.
    Start with showing where everything is:
    Menu > View > Show Layout/Invisibles
    Start with getting rid of any excess returns you may have used to "position" things. Next cut and paste objects like textboxes, shapes, charts and tables "Inline" ie in as part of the text. If necessary also turn off text wrap on objects or minimise it so that doesn't push text completely out of the way.
    Insert Section breaks in the Text where you want fixed breaks in the layout these will provide separation between layout on different pages.
    Basically you need to clean up your layout or think about doing it another way.
    If there is a lot of layout, you will need to learn Pages methods for doing this in a WP template or do it in a Layout template where each page is individual and all objects are floating with no default text area.
    Peter

  • How to find what are all the rules and events are monitoring for specific server in SCOM 2007

    how to find what are all the rules and events are monitoring for specific server in SCOM 2007.
    I need to know what are all the events, services, and rules are monitored for the specific server.
    Kindly help me friends.

    how to find what are all the rules and events are monitoring for specific server in SCOM 2007.
    I need to know what are all the events, services, and rules are monitored for the specific server.
    Kindly help me friends.
    Thanks for the question Sandoss. This is something that we all come across at sometime.
    Thanks & regards, Sumit Agrawal
    The lack of this feature is an inexcusable oversight for an enterprise management product.  They have some serious lightweights making design decisions on the SCOM team. 5 thumbs down. 
    BTW the answer is probably LOTS of stuff. Literally 100's of workflows are running on any server. 
    The following OpsMgr DB query will list all running monitors on a server. Change the name of @srv. I think this works pretty well.  I'd like some feedback if something is missing.
    DECLARE @srv varchar(30)
    SET @srv = 'your name here'
    SELECT mon.displayName as monitor, bme.FullName,bme.DisplayName as object,
    case
        when s.HealthState = 1 then 'healthy'
        when s.HealthState = 2 then 'Warning'
        when s.HealthState = 3 then 'Critical'
        else 'N/A'
    end as Health
    FROM state AS s WITH (NOLOCK)
    left join BaseManagedEntity as bme WITH (NOLOCK) on s.basemanagedentityid = bme.basemanagedentityid
    left join dbo.MonitorView Mon WITH (NOLOCK) on Mon.ID = s.monitorid
    where
    bme.FullName like '%' + @srv + '%'
    and s.HealthState <> 0
    and mon.IsInternalRollupMonitor = 0
    and mon.IsExternalRollupMonitor = 0
    order by bme.DisplayName, mon.displayName

  • I have a MacAir, mid 2011 model, and want to view video on my TV.  I see that I need a mini display port to Hdmi but there are many of these.  What exatly do I need and how does one view a movie downloaded to the MacAir on a TV screen?

    I have a MacAir, mid 2011 model, and want to view video on my TV.  I see that I need a mini display port to Hdmi but there are many of these.  What exatly do I need and how does one go about viewing a movie downloaded to the MacAir on a TV screen?

    Welcome to Apple Support Communities
    That's exactly what you need. A Mini DisplayPort to HDMI adapter and a HDMI cable. See > http://support.apple.com/kb/HT4241?viewlocale=en_US
    This is the only way to view a video on the TV. After connecting your MacBook Air to the TV, image on your TV should show immediately. Then, press Command and F1 keys to mirror your MacBook Air display, and open the video

  • I just updated my iPad to OS5 and all of my apps are gone. What did I do wrong and how can I get them back? Several were paid for. Thanks

    I just updated my iPad to OS5 and all of my apps are gone. What did I do wrong and how can I get them back? Several were paid for. Thanks

    If you have failed to make sure that any apps purchased on the iphone were transferred to your computer before updating, then you will have to redownload.
    Open itunes store, click Purchased, under Quick Links.

Maybe you are looking for