[ トップページ ]

« Windows 7 製品版のインストールと 10 GB メモリによる日本語 Wikipedia 全体の検索 | メイン | WASS - Wikipedia から整理された検索結果をえる検索サービス »

ハッキング

Wikipedia 「軸づけ」 検索のインターネット上でのサービスをめざして

Wikipedia をネタにして 「軸づけ検索」 をひろくためせるようにしたいというおもいは,ずっとまえからあった. 「Windows 7 製品版のインストールと 10 GB メモリによる日本語 Wikipedia 全体の検索」 などの項目に書いたように,ようやくそれにちかいことが実現しようとしている.

[この項目は 「カナダからのブログ: Windows 7 製品版のインストールと 10 GB メモリによる日本語 Wikipedia 全体の検索」 から投稿日時もふくめてコピーしたものです.]

以前の 「軸づけ検索」 はディスク上の 2 種類のインデクスを使用する検索法だった. しかし,時代もかわって,世界大百科事典くらいのテキスト量 (200 MB 程度) ならもちろん,4 GB ほどある日本語 Wikipedia でもメモリ上で検索できるようになってきた (英語版だとまだきびしいだろう). 全文がメモリにのせられれば,逐次検索でも,しかるべき時間で検索できるはずだ. ということで,今回はまずはインデクスをつくらずに,もっとさぼった方法で検索をこころみた.

WikipediaSearchExample.jpg 結局,日本語 Wikipedia ではまったくインデクスなしだと時間がかかりすぎるので,最初のしぼりこみだけインデクスをつかって,あとは逐次検索でまにあわせることにした. 「軸づけ検索」 は細粒度の検索がうりものなので,以前は 「句」 単位 (実際は句読点ではさまれる範囲を単位とする) で検索した. しかし,今回は Wikipedia 検索の効率もかんがえて,段落単位の検索にした. しかし,最後の評価は 「句」 単位にしている.

とりあえずはローコストでサービスしたい. 10 GB のメモリを占有できるデータセンタのサーバを借りるとけっこうな金額がかかるので,まずは自宅においたサーバからはじめたいとかんがえている. これで完全なセキュリティはのぞめないとおもうが,できるだけセキュリティを確保するため,ホーム LAN とは VLAN をつかってセグメントをわけることにした. たまたま安価な VLAN スイッチを買うことができたので,ちょうどよい.

現在はインターネットとの接続が Yahoo BB の ADSL だ. このままではまともにサービスできないので光の契約が必要だが,とりあえず Windows 7 のファイアウォールとトリオモデム 3G の BB ルータの TCP ポート 80 にあなをあけ,Windows 7 上にインストールした XAMPP の設定をかえて,外部からアクセスできるようにしてみた. ただしい設定になかなかいきつかなかったが,ようやく設定して iPhone 3G で URL を指定してみると,たしかにアクセスできた. ただし,たいていのキーワードで大量の検索結果がえられるので,アクセスできることをたしかめたら,全部の結果をうけとるまえに切断してしまった.

こういうわけで,一応はインターネット経由で検索できたが,まだ公開するにはいくつかの問題を解決する必要がある. バグもつぶす必要があるが,なによりも検索結果の量をおさえるくふうが必要だ.

関連ページ (2009-12-13 追記):

キーワード:

トラックバック

このエントリーのトラックバックURL:
http://www.kanadas.com/mt/mt-tb.cgi/4344

コメント (88)

Very nice site! [url=http://oixypea2.com/oxosyqr/2.html]cheap goods[/url]

whoah this blog is fantastic i really like studying your articles. Keep up the good paintings! You understand, many individuals are looking around for this info, you could aid them greatly.

whoah this blog is fantastic i really like studying your articles. Keep up the good paintings! You understand, many individuals are looking around for this info, you could aid them greatly.

whoah this blog is fantastic i really like studying your articles. Keep up the good paintings! You understand, many individuals are looking around for this info, you could aid them greatly.

Hi, Neat post. There is a problem with your web site in internet explorer, would check this IE still is the market leader and a large portion of people will miss your magnificent writing because of this problem.

Hi, Neat post. There is a problem with your web site in internet explorer, would check this IE still is the market leader and a large portion of people will miss your magnificent writing because of this problem.

Hello. excellent job. I did not expect this. This is a great story. Thanks!

Hello. excellent job. I did not expect this. This is a great story. Thanks!

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. All the best

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. All the best

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. All the best

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. Cheers

from:

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. Cheers

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. Cheers

Hi there, I found your site by way of Google while searching for a comparable matter, your web site got here up, it looks good. I have bookmarked it in my google bookmarks.

Hi there, I found your site by way of Google while searching for a comparable matter, your web site got here up, it looks good. I have bookmarked it in my google bookmarks.

Hi there, I found your site by way of Google while searching for a comparable matter, your web site got here up, it looks good. I have bookmarked it in my google bookmarks.

I will immediately grab your rss feed as I can not find your email subscription link or enewsletter service. Do you've any? Please let me know in order that I could subscribe. Thanks.

I will immediately grab your rss feed as I can not find your email subscription link or enewsletter service. Do you've any? Please let me know in order that I could subscribe. Thanks.

I will immediately grab your rss feed as I can not find your email subscription link or enewsletter service. Do you've any? Please let me know in order that I could subscribe. Thanks.

Perfect webpage you have at this website! Precisely how could i add in this blog's feed into my Rss reader?

for:

Perfect webpage you have at this website! Precisely how could i add in this blog's feed into my Rss reader?

Definitely pent topic matter, appreciate it for selective information.

fast:

Definitely pent topic matter, appreciate it for selective information.

This is really attentiongrabbing, You're a very professional blogger. I have joined your rss feed and sit up for in search of extra of your fantastic post. Also, I have shared your site in my social networks!

fast:

This is really attentiongrabbing, You're a very professional blogger. I have joined your rss feed and sit up for in search of extra of your fantastic post. Also, I have shared your site in my social networks!

Thanks again for the blog post.Thanks Again. Cool.

here:

you use disallowed a designer to make the style? Superb vocation!

Thank you for the auspicious writeup. It in fact was a amusement account it. Look advanced to far added agreeable from you! By the way, how can we communicate?

you're truly a just right webmaster. The site loading speed is incredible. It kind of feels that you are doing any distinctive trick. In addition, The contents are masterpiece. you've performed a magnificent task in this subject!

1000s of Show Gambler, since the Lastly associated with Sept ..

Paul:

Hello, i think that i saw you visited my site so i came to return the favor.I am trying to find things to enhance my web site!I suppose its ok to use some of your ideas!!

side:

Farmville farms even include free gift that is

Farmville farms even include free gift that is

Hello, I desire to subscribe for this blog to obtain most recent updates, thus where can i do it please help.

I really like your writing style, good information, thankyou for posting D.

Hello, I desire to subscribe for this blog to obtain most recent updates, thus where can i do it please help.

you have a terrific blog here! would you like to make some invite posts on my weblog?

Good day! I know this is kind of off topic but I was wondering if you knew where I could find a captcha plugin for my comment form? I'm using the same blog platform as yours and I'm having problems finding one? Thanks a lot!

fast:

You're so interesting! I don't think I have read anything like this before. So wonderful to discover somebody with some unique thoughts on this subject matter. Seriously.. thank you for starting this up. This website is one thing that is needed on the internet, someone with a bit of originality!

fast:

You're so interesting! I don't think I have read anything like this before. So wonderful to discover somebody with some unique thoughts on this subject matter. Seriously.. thank you for starting this up. This website is one thing that is needed on the internet, someone with a bit of originality!

fast:

You're so interesting! I don't think I have read anything like this before. So wonderful to discover somebody with some unique thoughts on this subject matter. Seriously.. thank you for starting this up. This website is one thing that is needed on the internet, someone with a bit of originality!

Mark:

You're so interesting! I don't think I have read anything like this before. So wonderful to discover somebody with some unique thoughts on this subject matter. Seriously.. thank you for starting this up. This website is one thing that is needed on the internet, someone with a bit of originality!

Appreciate it for helping out, great information.

Appreciate it for helping out, great information.

Appreciate it for helping out, great information.

uk:

omg! cant picture how quick time pass, after August, ber months time already and Setempber may be the 1st Christmas season in my location, I genuinely really like it!

uk:

omg! cant picture how quick time pass, after August, ber months time already and Setempber may be the 1st Christmas season in my location, I genuinely really like it!

omg! cant picture how quick time pass, after August, ber months time already and Setempber may be the 1st Christmas season in my location, I genuinely really like it!

side:

I was looking through some of your blog posts on this internet site and I conceive this web site is rattling informative ! Keep on posting .

Hello There. I found your blog using msn. This is a really well written article. Ill make sure to bookmark it and return to read more of your useful information. Thanks for the post. I will definitely return.

You are my inhalation, I have few web logs and rarely run out from post

You are my inhalation, I have few web logs and rarely run out from post

Paul:

You are my inhalation, I have few web logs and rarely run out from post

I like what you guys are up too. Such smart work and reporting! Keep up the superb works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site

I like what you guys are up too. Such smart work and reporting! Keep up the superb works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site

I like what you guys are up too. Such smart work and reporting! Keep up the superb works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site

I like what you guys are up too. Such smart work and reporting! Keep up the superb works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site

6:

Heya im for the first time the following. I discovered this specific table as a consequence I to discover The item faithfully of use & the idea rallied round myself publicized lots. I am hoping to deliver a little back again furthermore foster further like so

Because here is a list of multiplayer games is that the leave was asked for more.

If you are going for best contents like myself, simply go to see this site all

for:

Hello, i think that i saw you visited my site so i came to return the favor.I am trying to find things to enhance my web site!I suppose its ok to use some of your ideas!!

You produced some decent points there. I looked on the net to the problem and discovered many people goes together with along along with your web site.

You produced some decent points there. I looked on the net to the problem and discovered many people goes together with along along with your web site.

Where To Purchase Generic Ciprofloxacin 0.3 5ml in Albuquerque

I'm not sure exactly why but this weblog is loading very slow for me. Is anyone else having this problem or is it a problem on my end? I'll check back later and see if the problem still exists.

Immigration Lawyers ...the time to read or pay a visit to the content or internet sites we have linked to below the...

reverse lookup cell phone free Your positions constantly have a decent amount of really

I think you have noted some very interesting points , appreciate it for the post.

I think you have noted some very interesting points , appreciate it for the post.

in:

Perfect webpage you have at this website! Precisely how could i add in this blog's feed into my Rss reader?

Wow! This could be one particular of the most useful blogs We've ever arrive across on this subject. Actually Excellent. I'm also an expert in this topic so I can understand your hard work.

Wow! This could be one particular of the most useful blogs We've ever arrive across on this subject. Actually Excellent. I'm also an expert in this topic so I can understand your hard work.

Woah! I'm really loving the templatetheme of this website. It's simple, yet effective. A lot of times it's hard to get that perfect balance between usability and visual appeal. I must say you have done a great job with this. In addition, the blog loads super quick for me on Firefox. Excellent Blog!

I like this post, enjoyed this one regards for putting up. The goal of revival is conformity to the image of Christ, not imitation of animals. by Richard F. Lovelace.

My own wife and I fell over here by a poles apart trap forward also contemplated I'd personally restraint points unconscious. I like exactly what I envision i really am located absolutely charting you. Look forward to

The data are part of an autumn of just about 16 targets in Lib Dem provide because of the 2010 commander selection, before Huhne scooped 46.5 with all the electionHermes kelly felix bags didn can far in order to move benefit

location within my public complexes!

I relish, cause I discovered just what I used to be taking a look for. You've ended my 4 day lengthy hunt! God Bless you man. Have a great day. Bye

Im not that much of a online reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your site to come back later. All the best

buy:

Wow, this article is fastidious, my younger sister is analyzing these kinds of things, thus I am going to convey her.

Over the course of the initial period, they began to flrm group identities.

I conceive this website has got some rattling superb info for everyone. Dealing with network executives is like being nibbled to death by ducks. by Eric Sevareid.

Thank you for every other informative blog. The place else may just I get that type of info written in such a perfect means? I've a project that I'm just now working on, and I have been at the glance out for such information.

cash:

I like this post, enjoyed this one regards for posting. He removes the greatest ornament of friendship, who takes away from it respect. by Cicero.

Because here is a list of multiplayer games is

Pretty great post. I just stumbled upon your blog and wanted

コメントを投稿


メインページアーカイブページも見てください.

Powered by
Movable Type 3.36