The future of IM4's N-Gram Generation

So what am I working on now? Basically, I've figured out a way to batch process author's texts in order to create not only dictionaries, but n-gram biases from their works, and further, n-gram biases of their part of speech tags. The information is then composited into one large JSON file, which is normally too large to stuff in a blog post which is partially why I have not updated this site in some time.

This site is fundamentally a sandbox for me develop web-based extensions for IM4 and other text generation projects. Unfortunately, blogger has a 1 meg maximum for any single post and the data often exceeds that count.

So now I've begun working on ways to make the ngram generator responsive to given inputs.

var switch = "CIV3";

var s = "Emma Goldman:";
s += "\n";
out( s );
ngram("Emma Goldman", 100, "death", switch);
out "\n";
out "\n";
out "\n";

s = "William Butler Yeats";
s += "\n";
out( s );
ngram("William Butler Yeats", 100, "death", switch);
out "\n";
out "\n";
out "\n";

s = "Walt Whitman";
s += "\n";
out( s );
ngram("Walt Whitman", 100, "death", switch);
out "\n";
out "\n";
out "\n";

A JSB script like the above can generate however many ngrams on a given topic, in this case, death. There are 5 different switches to choose from which select ngram links in various ways.

The output is then something like this:

Emma Goldman:
death and then and, Redistributing or dangerous vessel, to celebrate the roast. At Paris The chastisement and succeeded in Liberty and is he faithfully honored the sympathies of a year. periods, and beauty is dead. Nicholas
criminalite
stagnation and chances. among other and educational corporation organized Jewish
consumptive the breast, and ideals ever so disastrous. as incomprehensible Churches than refer to his trade, in vision to attract and arrest they hold of organized manner. I Dignity, yet within the _contradiction
try the characters than fatuous, how did no new ideas, by sending their bodies was blind force. It the miners


William Butler Yeats
death

loadstone
abide

eared hounds

agile thigh were blotted out. alone nine years, that foam a knife to age that woven world where pan's
calculation number, measurement, replied?

sacred company of this foul witch

reigned
enmity

cradles right.

scarecrow
grief swayed in times troubled me

claimed his pupils

smooths the livid chop

dice beat up between the help

patient ear

doric
too had been. content you went and soul

creeps through

swimming
leagues oversea,

ranger

woman in vain mood

separate perfect, beauty dressed


Walt Whitman
death I INSCRIPTIONS
lemon and female, of perfumes, heat rush of waters, the lifted above so dear eyes pluck, no philosophy, politics, or men I INSCRIPTIONS
mare shames silliness out there can upon men, and drums as first, just shines on yet looked through her breath's
stopped at him these constituted

today

ribbons and Fifth section, here long too hot,'
cools the sleigh bells, the Nile,
being as first,

perturbed winds blown and soothing Death, years, nor touch face from mortal diarrhoea, with blue white lipped cannon, were spun are cut in abeyance,

district
impression the


TS Elliot
death before

presume

cases poured in bars.

youth

cet âge...
osiris Anyone in corridors

concerning

array
required to windward, 320
honour
binary

cleopatra II. ii.,
shell

madame
rats are raising dingy shades

alley

hothouse grapes;

christum existentem filium Patris;
convenience

laquearibus aureis incensi, et la cargaison d'etain:
slight sensation of great matter;

stairs unlit .
employed

arrived

regarded as it you and dim.

poems by

not familiar with this work on drinking tea.

zu

desk when do now? What she




HD
death

donate royalties Special
teeth

twisted no longer

fever

gift

prayer alike,

two before you,
permanent
bellowing and jewelled halter

deletions
beaten

ash

steep shelf

send no changing it ...
depart in cloth,

his coral

principal
occur
veiled figure of foam,

damages
unsolicited
shakes the strings grow stronger than this. eBook complying with swift rain, that kept and created new city, so fragile, taller children, of Love, our strength of strife break

grain

nearer you?
athens

unkissed

love what foam, and linen, carefully

..Which can then be used to create themed poetry like the stuff you see here: http://antiliterature.blogspot.com

That, in short, is what I my efforts are currently geared toward. Thanks for looking in.

JYNX