Tool chain to process Japanese WikiPedia text

Wikipedia$B$NF|K\8l%F%-%9%H$r=hM}$7!"(B
$B8@8l$NE}7W%b%G%k$N%Q%i%a!<%?$r7hDj$9$k%D!<%k%A%'!<%s$G$9!#(B

$B$+$J4A;zJQ49%(%s%8%s(BAnthy$B$N@-G=$r8~>e$5$;$k$3$H$r<g$KL\;X$7$F$$$^$9!#(B


--Files and Directories
README
   $B$3$N%U%!%$%k(B
extract_sentence.rb
   Wikipedia$B$N%G!<%?%Y!<%9$N(BXML$B%U%!%$%k$+$iF|K\8l$NJ8$r$H$j$@$9(BRuby$B%9%/%j%W%H(B
make_transition.cpp
   Anthy$B$N7ABVAG2r@O4o$N=PNO$h$j!"J8@a%/%i%9$NA+0\IQEY$J$I$r5a$a$k(B
freq_to_transition.cpp
   $BA+0\IQEY$h$jA+0\$N=P8=3NN($d>r7oIU3NN($r5a$a$k(B
make_me_params.cpp
   $BA+0\$N=P8=3NN($r3X=,%G!<%?$H$7$F!"(B
   $B:GBg%(%s%H%m%T!<%b%G%k$K$h$C$FA+0\$N>r7oIU3NN($r5a$a$k:]$N%Q%i%a!<%?$r7hDj$9$k(B