Semantic Desktop - only 100 files in the index, Dolphin-find doesn't work

[wired2051]

After updating to Kubuntu 13.04 with KDE 4.10.5 KMail said that the Semantic Desktop isn't running. Nepomik-Semantik-Services and E-Mail-Indexing were already activated, now I also activated File-Indexing. After that KMail runs without the message. But the find-function <strg><f> in Dolphin doesn't work anymore - and I used it very often before, it worked fine.

After looking in the Nepomuk-Server Details I discovered that only 15 files were in the Index. So I run Nepomukcleaner. After that 20 files were in the index. But find still doesn't work in Dolphin.

Now I looked in the folder selection. Only my Data (own partition /dev/sdb7 on same HDD) was selected, as I wish. For testing I selected also my home-folder. Now there are 100 files in the index. But there should be nearly 50.000 files.

Please help. At least I hardly miss Dolphin's find! I want to use it again.

[Rog132]

Nepomuk find

Earlier

Kubuntu forums & Nepomuk & Find :http://www.google.fi/#bav=on.2,or.r_...uforums.net%2F


Number of indexed files

Kubuntu 13.04 / KDE 4.10.5

Indexing settings: KDE System Settings > Desktop Search >Indexing tab.


The KDE System Settings > Desktop Search >Basic Settings tab > Details >...

It is showing something but it is not the files in the Nepomuk database.



The Dolphin find with the joker/asterisk is telling 958 folders/ 9564 files.

Dolphin information/warnings/errors/...

Earlier: http://www.kubuntuforums.net/showthr...rom-the-K-menu

Start the kdebugdialog with the fullmode:

kdebugdialog --fullmode

1) Enable Dolphin information/warnings/errors - if they are disabled.
2) Start the Dolphin from the konsole
3) Try to find something - Are there error messages ?

[wired2051]

Thanks for your help!

Dolphin shows 27 files with 172,5 MB, Krusader at the same time shows 40.000+ files. And it's no problem with the file type because Dolphin shows 10 *.od* files and Krusader 1.900+ office files.

Thanks for the kdebugdialog hint, I didn't know. Unfortunately I didn't see any relevant errors. There are links to two NAS but the most data is local.

USER@RECHNER:~$ dolphin
Fontconfig warning: "/etc/fonts/conf.d/50-user.conf", line 9: reading configurations from ~/.fonts.conf is deprecated.
dolphin(3545) KActivities::ResourceInstance::setTitle: Setting the title:  ""
QPixmap::scaled: Pixmap is a null pixmap
dolphin(3545) KSambaSharePrivate::isSambaInstalled: Samba is not installed!
dolphin(3545) KSambaSharePrivate::isSambaInstalled: Samba is not installed!
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:
dolphin(3545)/kdecore (KConfigSkeleton) KCoreConfigSkeleton::writeConfig:

I also tried debug mode in nepomukstrigirc but ~/.kde/share/data/nepomuk/file-indexer-error.log is not created and ~/.kde/share/data/ doesn't exists.

[Rog132]

Dolphin shows 27 files with 172,5 MB, Krusader at the same time shows 40.000+ files...

Well the Krusader is not using the Nepomuk.


Something to try:

A KDE Service Menu - http://trueg.wordpress.com/2011/12/0...lders-is-easy/




Another way - Removing the Nepomuk database and starting from the scratch: http://askubuntu.com/questions/28605...indexing-files


At here - the service menu seems to add files to the Nepomuk database - that is: IF they are in the user's home directory.

[wired2051]

I relay appreciate your help!

Something to try:
A KDE Service Menu

KDE Service Menu? I tried Dolphin > Right Mouse Button but there is no Desktop Search-Menu. Will it be added completely?

Another way - Removing the Nepomuk database and starting from the scratch:

Looks fine to me because there are no (end never will be any) manual annotations to the files. But I don't understand rudimentally what this code do. And why only indexing *.pdf and *.odt? Have I do it manually with all Office-, txt-, Kontact- and whatever files? The MIME-Type-List is long...

And I already tried nepomukcleaner with only a little but no impressing result (see first post).

At here - the service menu seems to add files to the Nepomuk database - that is: IF they are in the user's home directory.

I'm afraid that my data isn't indexed because it's on an different partition, only linked under ~/. But I'm surely not the only guy organizing his PC like that and my data-folder is shown (and selected) in in the folder-selection of Nepomuk.

And at least, why does Dolphin's find work before activating Nepomuk-file-indexing but not after?

Sorry for my insisting questions but I'm nervous before doing changes on my system with code I didn't understand.

[Rog132]

Take 2

KDE Service Menu? I tried Dolphin > Right Mouse Button but there is no Desktop Search-Menu. Will it be added completely?

Copying from the A KDE Service Menu - http://trueg.wordpress.com/2011/12/0...lders-is-easy/

(Is the link visible ??)

In the meantime I threw together a small desktop file which adds two new actions to the context menu of folders.

(Re-)index Folder contents will make the indexer update all the files in the folder indifferent of their state in Nepomuk. This includes fixed unicode strings.
(Re-)index Folder contents recursive does the same as the above except that it also recurses into sub folders.

Simply put the following into a file called “nepomuk-index-folder.desktop” and save it in “~/.kde/share/kde4/services/ServiceMenus”. At the next start of Dolphin or Konqueror the two new actions will be available.

[Desktop Entry]
Type=Service
X-KDE-ServiceTypes=KonqPopupMenu/Plugin,inode/directory
Actions=indexFolder;indexFolderRecursive;
X-KDE-Submenu=Desktop Search
Icon=nepomuk
 
[Desktop Action indexFolder]
Name=(Re-)index Folder contents
Icon=nepomuk
Exec=qdbus org.kde.nepomuk.services.nepomukfileindexer /nepomukfileindexer org.kde.nepomuk.FileIndexer.indexFolder %f 0 1
 
[Desktop Action indexFolderRecursive]
Name=(Re-)index Folder contents recursive
Icon=nepomuk
Exec=qdbus org.kde.nepomuk.services.nepomukfileindexer /nepomukfileindexer org.kde.nepomuk.FileIndexer.indexFolder %f 1 1

It will add the Re-index actions to the Desktop search service menu (1).



The (2) is http://www.kubuntuforums.net/showthr...data-Extractor
The (3) is http://www.kubuntuforums.net/showthr...l=1#post288658

...But I don't understand rudimentally what this code do...

The qdbus /1/ call will stop the nepomukserver.

The 'rm' is remove. You could read more of the remove from the 'man rm' /2/
The remove will remove the nepomuk database. I wouldn't run it - I would open the Dolphin to the ~/.kde/share/apps/nepomuk/repository/ and rename/move/remove the files with the Dolphin.

And why only indexing *.pdf and *.odt? Have I do it manually with all Office-, txt-, Kontact- and whatever files? The MIME-Type-List is long...

They are examples - and the current nepomuk developer Vishesh Handa /3/ is blogging /4/:

With the 4.10 release of Nepomuk, we decided to move away from Strigi and write our own indexers. We support most of the commonly used formats. Also, the new code is faster and more importantly more maintainable and easier to contribute to. So far this decision has worked pretty well for us.

That being said - we still do not have enough indexers...

I'm afraid that my data isn't indexed because it's on an different partition, only linked under ~/. But I'm surely not the only guy organizing his PC like that and my data-folder is shown (and selected) in in the folder-selection of Nepomuk...

Well - So do I. I only have small 10 GB home - the data is on the bigger data partitions. The KDE Userbase /5/ has Nepomuk /6/ section. It is telling:

Note that Strigi as of KDE 4.7 does not follow symbolic links (bug #208602). Up to KDE 4.9, even if the user selects folders under the symbolic link for indexing (bug #287593), content will not been indexed. The specific bug has been fixed. Thus, the user will be able to see the symbolic links, but she/he will not be allowed to mark any of them for indexing. (A symbolic link is a file that "points" to another file or directory; Dolphin displays symbolic links in italic.) You must find the path to the actual directory (in Dolphin, select the file, choose Properties -> General -> Points to) and tell Strigi to index that.

I'm not sure what is the situation with the KDE 4.10/11 but I noticed that the re-index service menu / Dolphin find didn't seem to work if the data was on other partition.

why does Dolphin's find work before activating Nepomuk-file-indexing but not after?

I don't use the Dolphin find so I can't say - Maybe the Dolphin is having internal find as a backup ?

As I wrote - most things of Nepomuk & Find has been said earlier: http://www.google.fi/#bav=on.2,or.r_...uforums.net%2F

Picking few:
-> Recoll/KFind : http://www.kubuntuforums.net/showthr...les-by-content
-> Recoll/KFind : http://www.kubuntuforums.net/showthr...-*really*-work

...but I'm nervous before doing changes on my system with code I didn't understand.

That is a great principle !!! Keep it.




Links

1. http://techbase.kde.org/Development/...oduction#qdbus
2. http://www.kubuntuforums.net/showthr...mentation-help
3. http://vhanda.in/blog/
4. http://vhanda.in/blog/2013/05/we-need-more-indexers/
5. http://userbase.kde.org/Welcome_to_KDE_UserBase
6. http://userbase.kde.org/Nepomuk

[wired2051]

Copying from the A KDE Service Menu - http://trueg.wordpress.com/2011/12/0...lders-is-easy/

(Is the link visible ??)

Yes, it is. But I don't really like changes in the GUI, negative experiences.

Thank you for this detailed answer. I like to learn.

The KDE Userbase /5/ has Nepomuk /6/ section. It is telling:

EUREKA! You got it

I disabled ~/Data and enabled /media/Data instead in the folder-selection and immediately the indexing started. Now, after the first run, Nepomuk says there are 38 991 files indexed. That is matching to the count Krusader calculated.

And now, find in Dolphin works again! (btw. a greate and simple to use feature, give it a try)

THANKS A LOT for your help and your patience!

But allow me a last comment: it's not a good idea to fix the display of symbolic links in the folder-selection-dialog without fixing the indexing bug itself. my2cent