Skip to content

Instantly share code, notes, and snippets.

View naoa's full-sized avatar

Naoya Murakami naoa

17 followers · 0 following
View GitHub Profile
@naoa
naoa / word2vec_server.py
Last active August 29, 2015 13:58
word2vec http server program %python word2vec_server.py <model_file_path> <port> cosine example client:curl "127.0.0.1:8000?c=test&n=10" analogy example client:curl "127.0.0.1:8000?pos=king%20woman&neg=man&n=10"
# coding=utf-8
import sys
import socket
import select
from urlparse import urlparse, parse_qs
import word2vec
argvs = sys.argv
port = 8000
@naoa
naoa / wn_morph.c
Created April 5, 2014 19:45
compile: gcc -I/usr/include/glib-2.0 -lglib-2.0 -lWN wn_morph.c -o wn_morph dependency:glib2 glib2-devel wordnet wordnet-devel
#include <stdio.h>
#include <string.h>
#include <stdlib.h>
#include <wn.h>
#define MAX_STRINGS 65535
#define MAX_BUF_NUM 4096
#define MAX_BUF_SIZE 255
int main(int argc, char *argv[])
{
@naoa
naoa / kanji-kana-suggest.php
Created December 9, 2013 01:07
<?php
$input_file = $argv[1];
if($argc >= 3){
$output_file = $argv[2];
}
else{
$output_file = "";
}
@naoa
naoa / kanji-kana.php
Last active September 1, 2023 09:17
from kanji to katakana convert
<?php
$input_file = $argv[1];
if($argc >= 3){
$output_file = $argv[2];
}
else{
$output_file = "";
}
@naoa
naoa / category_enals.php
Created December 8, 2013 10:32
This script has the feature that extract English wikipedia's category has only alphabets, digits, and spaces. %php category_enals.php<database> <output_file>
<?php
$db = "127.0.0.1";
$db_name = $argv[1];
$table = "category";
$username = "mysql";
$password = "";
$output_file = $argv[2];
@naoa
naoa / wiki_fts.php
Created December 8, 2013 10:29
This script has the feature that select full text phrase search from line text in text_file. %php wiki_fts.php <database> <text_file> <output_file>
<?php
$db = "127.0.0.1";
$db_name = $argv[1];
$table = "text";
$index = "title,text";
$username = "mysql";
$password = "";
$category_file = $argv[2];
@naoa
naoa / category_jpfw5.php
Last active December 30, 2015 12:19
This script has the feature that extract wikipedia japanese category . %php category_jpfw5.php <database> <output_file>
<?php
$db = "127.0.0.1";
$db_name = $argv[1];
$table = "category";
$username = "mysql";
$password = "";
$output_file = $argv[2];
@naoa
naoa / index_dump.rb
Last active December 29, 2015 08:49
Groonga index dump
require "groonga"
database_path = ARGV[0]
ft_index = ARGV[1]
output_file = ARGV[2]
Groonga::Database.open(database_path)
index_column_name = "#{ft_index}.index"
index = Groonga[index_column_name]
index.table.open_cursor do |table_cursor|
index.open_cursor(table_cursor) do |cursor|
current_term_id = nil
@naoa
naoa / wiki_fts_1.php
Last active December 29, 2015 05:09
This script has the feature that select full text search from line text in text_file. %php wiki_fts_1.php <database> <text_file> <output_file>
<?php
$db = "127.0.0.1";
$db_name = $argv[1];
$table = "text";
$index = "title,text";
$username = "mysql";
$password = "";
$category_file = $argv[2];
@naoa
naoa / wiki_page_import.php
Last active December 29, 2015 04:49
This script has the feature that import wikipedia page XML. %php wiki_page_import.php <database> <wiki_articles_xml_dir> <output_file>
<?php
$db = "localhost";
$db_name = $argv[1];
$table = "text";
$username = "mysql";
$password = "";
$article = $argv[2];
$output_file = $argv[3];