Skip to content

Instantly share code, notes, and snippets.

@mattsta
Last active August 29, 2015 13:57
Show Gist options
  • Save mattsta/9586673 to your computer and use it in GitHub Desktop.
Save mattsta/9586673 to your computer and use it in GitHub Desktop.
Word frequency of comments about a post about someone being mentally abused at work. Words obtained from this comment thread: https://news.ycombinator.com/item?id=7408055
(world)matt@ununoctium:~/repos/wf% python text.py drama | fold -s
===============================================================================
Count of sentence ending words:
72: it.
35: sexism.
31: them.
24: people.
23: company.
20: me., story., work., not.
19: problem., github.
18: that., here.
17: too., etc., way., this.
16: you., wife., situation.
15: culture.
14: environment., well.
13: all., though., on., her., sexist.
12: to., do.
11: line., there.
10: case., employees., wrong., time., thing., is., employee., female.
9: check., power., happened., women., racism., so., woman., out.
8: gender., no., problems., be., business.
7: agree., issue., true., things., anything., behavior., him., men., cause.,
context., down., job., place., happen., comment.
6: issues., attention., involved., e.g., unprofessional., point.,
inappropriate., again., right., code.
5: up., now., better., discussion., otherwise., are., money., other.,
question., matter., one., ways., horvath., relationship., bad., crazy., man.
4: stare., thread., hand., situations., times., meritocracy., want., said.,
away., with., i.e., possible., co-worker., of., day., team., mind.,
themselves., experience., organization., sick., x., accurate., like., person.,
process., much., club., in., action., reason., attractive., drama., mess.,
opinion., about., chance., through., unacceptable., shit., watching., us.,
color., false., judgement., fired., evidence., life., article., music.,
stubborn., leave., white.
3: project., word., actually., bias., colleagues., awkward., then., office.,
important., hiring., either., truth., disappointing., techcrunch., startup.,
great., jobs., ridiculous., any., control., offense., actions., quit., else.,
group., weird., past., yes., fun., staring., period., date., elsewhere.,
anyway., reasons., doing., powerless., tv., politics., public., show., staff.,
worse., partner., community., feelings., lot., black., hostile., whole.,
anymore., covertly., boy., together., reasoning., worst., sense., incident.,
why., ignored., mistakes., approach., individuals., reacts., same., children.,
narrative., later., flawed., perspective., curious., can't., management.,
something., conclusions., exists., personal., understand., can., commits.,
workplace., for., internet., event.,
http://www.bhorowitz.com/how_to_minimize_politics_in_your_co., different.,
relationships., logs., back., humanity., tech., news.
===============================================================================
Words below occurred more than 3 times.
[Number]: is the number of times the words appeared in the data.
Words are all normalized to lowercase.
===============================================================================
283: it's
270: people
234: like
203: would
188: one
185: github
169: don't
164: women
162: company
158: think
155: work
133: wife
132: even
131: someone
130: i'm
127: sexism
116: really
112: see
105: story
104: that's
103: men
96: make
92: you're
91: get
90: something
88: good
85: also
83: problem
82: male
80: way, point
78: say, know
76: employee, thing, seems, can't, time
74: could
72: much
71: situation
70: may, culture, woman, well
69: things
68: founder
66: doesn't
65: going, hula
63: female
62: person
59: article, take, isn't, actually
58: sexist
57: code, lot
56: employees
55: many, sure, anything, business, want
54: saying, wrong
52: without, office
51: go, probably, horvath, hr
50: gender, sounds, still, issue, pretty
49: case, right, power
48: need
47: said, hooping
46: might
45: better
44: tech, white, makes, find
43: environment, us, founder's, i've
42: look, question, either, behavior, making, true
41: bad, there's, didn't, issues, though
40: anyone, comment, yes, stop, less
39: feel, two
38: whether, never
37: likely, companies, mean
36: involved, problems, fact, social
35: maybe, management, hard, evidence, black
34: different, inappropriate, wasn't, completely, reason, i'd
33: personal, happen, says, else
32: sort, crazy, everyone, based, read, quite, another, she's, line, trying,
whole, agree
31: unless, clear, try, job, race, workplace, sexual, public, man
30: made, working, watching, experience, manager, understand, nothing, side,
happened
29: means, rather, keep, part, every, we're, place, guy, dating, staring
28: life, hour, relationship, getting, always, etc, kind, long, matter, enough,
least, coworkers, professional
27: group, hoop, possible, course, believe, avoid
26: far, partner, cause, response, reverting
25: looking, assume, thought, everything, talk, worked, shit
24: level, certain, away, felt, high, call, attractive, team, got, bit,
wouldn't, told
23: use, commits, co-worker, back, obviously, important, big, events, first
22: gawking, around, thread, started, able, lack, socially, however, whatever,
society, done, comments, similar, especially
21: stare, quit, account, help, changes, unprofessional, since, given, legal,
general, ever, statement, sense, position, seem, opinion, guys, asked, best
20: enneff, entire, context, often, hula-hooping, taking, talking, let,
meritocracy, words, others, simply, come, example
19: real, they're, guess, works, love, term, racism, incident, common, truth,
personally, ask, last, spouse, yet
18: sound, information, little, towards, organization, project, give, exactly,
calling, drama, used, change, attention, x, put, seen, tell, world
17: happens, great, word, situations, discussion, girls, rule, start, private,
serious, aren't, techcrunch
16: deal, reasons, within, community, respect, fine, clearly, relationships,
necessarily, explain, access, shouldn't, goes, instead, sitting, what's,
coworker, standard, judgement, although, day, room, supposed, otherwise, view
15: greenrd, definition, certainly, already, worse, founders, sides, actions,
claims, past, heard, seriously, cannot, architect, reasonable, imagine, hear,
stories, aggressive, wanted, jd0
14: consider, chain, absolutely, money, yeah, sex, single, perspective, open,
end, ways, discrimination, young, /, assuming, new, hope, full, watch, moment,
hn, significant, date, totally, proud, act
13: simple, merit, employment, check, bunch, described, fit, perhaps, lutusp,
fucking, outside, gets, happy, run, risk, none, lockewatts, let's, action,
you've, cases, pull, school, hostile, industry, value, uk, small, found,
entirely
12: i'll, useful, chat, thus, unacceptable, years, hiring, expect, victim,
harassment, hate, girl, leave, horvath's, generally, source, behind, music,
toxic, developers, difficult, startup, human, facepalm, allegations, hoola,
petty, evil, particular, post, data, must, hire, scenario, success, meaning,
times, specific, fear, ones, co-workers, left
11: control, set, exists, awkward, process, julie, mind, argument, related,
feelings, uncomfortable, parties, close, decisions, nerf, large, needs, zof,
he's, due, tend, almost, interested, role, easy, expected, perfectly, worth,
sexes, justification, okay, form, fire, differences, disagree, rug,
understanding, possibly, unwanted, become, actual, accurate, aware, color,
males, ok, longer, oh, tomp, straight, rights, boss, reverted, sometimes,
stuff, developer, english, fun, rejection, implication, someone's, history
10: equally, old, fired, straw, move, prefer, exist, strip, regardless,
apparently, engineer, dancing, thinking, positive, support, theorique,
political, needed, individuals, interest, forward, shared, reading, conflict,
play, fights, jobs, normal, club, advances, upon, hand, behaviour, leadership,
judge, news, difference, ruby, software, you'd, reaction, technical, age, gun,
leaving, turn, definitely, threat, activity, feeling, treated, powerless,
lying, proof
9: relevant, false, show, order, face, merely, random, unfair, hearing,
brought, effectively, attitude, resources, won't, using, politics, stand,
standards, usually, reasoning, later, whose, github's, sad, goal, create,
responsible, event, write, failed, state, doubt, strong, marriage, care, type,
law, conclusion, somehow, beyond, complaint, speaking, door, sick, name,
interactions, couple, crito, rejected, stay, break, erikpukinskis, jumping,
legitimate, mention, despite, immediately, highly, went, present, handled,
building, blame, protect, kept, unfortunately, presented, boy, else's, willing,
together, honest, looked, huge, benefit, obvious, smart, y, requests, weird,
nice, called
8: respond, upper, managers, logs, grievance, chances, hoopers, influence,
number, valuable, openly, result, allowed, hell, children, considered, wife's,
standing, partners, court, fuck, conclusions, lots, media, tried, opposite,
please, hey, passive, comes, complex, racist, behave, internet, objective,
party, weeks, previous, easier, board, development, product, nonsense, knows,
missing, rules, explanation, hopefully, focus, subjective, wonder, ridiculous,
idea, internal, press, hold, bringing, potential, commenters, colleagues,
romantic, publicly, skills, fault, capable, extremely, terrible, wait, husband,
resolved, conversation, honestly, somewhat, dialog, narrative, nature, advice,
piece, [1]
7: [deleted], particularly, soon, bring, including, thanks, skin, battle,
gossip, startups, superior, interesting, bench, blog, parents, innocent,
policy, sorry, surprised, details, handle, safe, overall, anyway, cultural,
putting, telling, projects, easily, places, lost, implying, revert, continue,
quick, ignored, directly, fair, facts, zero, accused, lawyer, manner, home,
points, hacker, sue, lead, defend, current, expressing, across, demonstrated,
one's, considering, free, ogling, meet, along, super, appears, undermine,
career, 100%, according, contract, argue, slightly, primarily, impossible,
truly, everybody, illegal, top, jealousy, negative, lol, next, live, basic, :,
eyes, elsewhere, unsafe, serve, basically, broke, circumstances, roles, second,
pr, tw268, suppose, emotional, engineers, beautiful, stubborn, share, equal,
couples, creepy, somebody, hit, ebfe, depending, provide, claiming, valid,
build, performance, several, higher, poor, picture, who's, lawyers, reverts,
welcome, friends, polite, bullying, chance, regular, allowing, complaints,
employers, judgment, parallel, structure, remember, sit, complexity,
reputation, command, worst, wow, usual
6: managed, rest, supporter, seemed, knowledge, tv, organisation, written,
writing, charge, differently, win, main, customers, sued, advantage, ceo,
horrible, early, answer, decide, realize, non-employee, formal, desire,
hula-hoop, reasonably, facing, edit:, harm, unfairly, measure, curious,
subject, and/or, pattern, decision, overly, waiting, version, exit, rational,
tends, approach, victim-blaming, ass, biased, clarify, step, members, alone,
grifpete, stage, advance, search, e.g, starts, leaves, philwelch, sensitive,
plus, massive, encourage, aka, seeing, major, suddenly, nsa, visibly, logical,
replace, losing, bizarre, trust, eyecandy, moron4hire, threatening, alleged,
quickly, pc, valley, friend, website, dialogue, acceptable, blaming, excuse,
stoptalkingshit, kansface, happening, keeping, gruntmaster9000, shame, cool,
future, site, this:, adults, upset, turned, head, middle, employee's, physical,
mutual, latter, offensive, gametheoretic, majority, setting, arguments,
department, ordinary, status, mess, crime, marktee, inherently, running, buro9,
gaius, opportunity, short, vezzy-fnord, largely, corporate, request, except,
intentionally, allow, senior, normally, original
5: inept, opinions, liar, affair, developed, should've, toward, assholes,
defended, held, looks, aspect, carefully, subtle, downvoted, perfect, clueless,
treat, feminist, somewhere, fix, sentence, character, opportunities, employer,
shouting, finally, jah, equity, upvotes, pride, personality, meant, dominant,
express, wives, matters, feels, front, discuss, following, regarding,
internally, beings, settle, offices, dealt, security, page, silently, enjoy,
prevent, btw, financial, rapists, physically, twitter, humans, 'girl',
plausible, depends, actively, year, racial, instance, stands, severance,
literally, conservative, size, correct, red, nailer, ends, recently, targeted,
threatened, met, efuquen, address, conflicts, i.e, essentially, interaction,
hula-hoopers, language, title, programming, days, ignoring, justice, [...],
pick, objectify, dismiss, executives, impression, family, gone, problematic,
watwut, period, dudes, walk, appropriate, involvement, likes, couldn't, apply,
bullied, speak, takes, service, basis, dude, three, specifically, secret, low,
motives, gives, interests, females, complete, allegedly, firing, becomes,
inclined, feminists, occurred, societal, hurt, lives, norms, former, posted,
topic, double, commit, hosting, decided, incidents, promoted, company's, scene,
dylan16807, claim, force, woman's, associated, played, cover, confused, accept,
drive, respected, clavalle, defending, arise, offense, rid, saw, posting,
forced, eruditely, complainant, anymore, incredible, technology, nobody, aside,
reality, note, field, strange, accusations, finding, solve, asshole,
sideburnsofdoom, week, explaining, draw, experienced, description, rude,
oppression, knew, effect, ball, helping, hired, anecdotal, purpose,
unattractive, coming, variable, changing, destructive, known, bitbucket, imply,
colour, bsder, changed, anybody, point:, implied, responsibility, greatest,
suggest, genuinely
4: shop, limited, atmosphere, concept, hierarchy, lgleason, agreed, executive,
legally, criticism, aren’t, inflexible, mistakes, classic, per, rdtsc,
mentioned, existence, skill, trivial, staff, letting, cut, referring, favor,
we've, dick, proportion, amazing, unhappy, clashes, add, explicitly, gphilip,
choose, pay, immature, zobzu, lies, tc, haven't, strings, eventually, victims,
loved, air, disagreement, intimidation, shitty, effects, anonymous, hands,
report, unique, investor, bullshit, minute, apart, batshit, resolve, equality,
countries, fully, married, gress, voidlogic, ignore, solved, stupid, predators,
positions, popular, muglug, cbsmith, michaelt, names, unabashedly, talked,
mental, throwing, dealing, scared, direct, jump, yearning, clubs, cost, design,
dynamics, resigned, bigger, oh_sigh, ethically, enemies, qualifies, ultimately,
scale, appear, offended, god, review, develop, lean, inside, stops, rivierakid,
pron, acting, asking, passion, ripping, screwed, values, learned, poorly,
filled, journalist, says:, led, chose, deleted, spot, gawk, reported, base,
key, people's, competent, sexy, invented, beginning, ancestors, faith,
mattdeboard, commenting, benefits, puts, origins, receive, universe, months,
suggests, became, expecting, weren't, testament, mouth, loud, second-guessing,
emotion, probable, via, statements, final, danger, variables, bullies, bound,
environments, exercise, accusation, peer, ann, send, hipchat, precisely,
establish, cloud, hitting, confidence, sadly, silent, usa, privacy, remains,
decent, angry, initial, system, unspecified, noticed, scenarios, attack,
describes, therefore, justified, taken, cultures,
https://news.ycombinator.com/item?id=7408466, treatment, wants, mentioning,
cat-calling, sharing, michaelochurch, initiated, apparent, realized, meddling,
genders, flawed, failure, races, protections, threaten, implies, irrelevant,
suffered, here's, info, organizations, b, boast, reserve, avoiding, reliable,
dev, humanity, record, compensation, pekk, silly, critical, dumb, z, person's,
geeks, disingenuous, enupten, accusing, larger, intimidating, half, contribute,
mine, sake, fellow, warning, pulling, iwasphone, organizational, crash,
property, opposed, tells, baddox, affairs, strength, angle, zaqokm, trial,
deserve, individual, holds, damage, everyday, belief, causing, useless, doors,
reactions, destroy, logicchains, founders', shows, exponentially,
acknowledging, staying, kinds, minority, programmers, gay, drink, healthy,
bothered, interpersonal, abuse, experiences, mentions, perceive, csense,
spelling, terribly, retrogradeorbit, concerns, kid, balance, prove, forever,
recourse, assets, required, author, lines, analysis, sounded, came, goals,
rsynnott, wronged, built, pyre, voting, starting, spend, homophobia, typical
3: semantic, dollar, leads, hanging, settlement, hmmm, supposedly, depend,
buddy, helps, whatsoever, dominated, friendly, activities, stipulate,
liability, accuse, awful, drinking, continued, vast, treating, perceived,
mercurial, marry, laying, chanux, deleting, ups, unaware, it'll, nknighthb,
tired, cossatot, street, video, casual, inanimate, experiment, conduct,
acjohnson55, degree, leg, jsmthrowaway, delivering, threads, hoops, backlash,
extreme, here:, ahead, guilty, prior, amount, rdl, narrow, options, involves,
thats, secure, story:, manage, psychological, moral, duck, total, eye, &,
stated, insult, mediate, recommend, strike, assessment, awesome, employees',
sociopath, successful, naive, one-sided, meetings, beers, labelled, ashamed,
excellent, glad, valued, reviews, paragraph, ms, providers, repos, involve,
assumptions, dropped, attract, occur, jah's, absolute, bossless, awkwardness,
verify, american, rape, explains, css, plans, stephp, earlier, collection,
achompas, ethics, types, attempt, noses, devs, 'woman', asserts, african,
definitions, erasing, episodes, paper, misconduct, cold, suffer, solarnet,
trouble, complainant's, police, acknowledge, solving, platform, covertly,
production, image, sabotaging, derefr, greater, bans, views, records,
communities, structural, intelligent, dobbsbob, stopped, vendettas, repeating,
knee-jercky, luck, noble, house, energy, owner, gaps, we'd, avoided,
adequately, special, network, space, valve, jessaustin, jkrems, shut,
reporting, turning, dictionary, resume, reacts, million, possibility, disputes,
org, quo, thrown, allies, route, length, removing, barriers, creepily, hearsay,
coding, rank, instances, carry, message, miss, leverage, interact, shiven,
paint, assumption, tom, messing, painful, murder, happily, wildly, mentality,
took, more-than-anything, western, focusing, symptom, population, critically,
boring, deserves, protected, guilt, outcome, einhverfr, nicer, pacabel, modern,
organisations, unlikely, relatively, afraid, genuine, come-on, self, shocked,
heterosexual, xylakant, wanting, blunt, unhealthy/toxic, men's, multiple,
ukrainian, breadwinner, harmful, involving, germany, plenty, tall, husband's,
episode, boys, babby, gather, drawing, you'll, absurd, reversions, typically,
joining, drastically, shot, didn’t, scotty79, purely, attempts, businesses,
debate, stubbornness, believing, dysfunctional, regularly, accident, hostility,
thefreeman, they'd, gendered, nearly, richards, burned, distraction,
grievances, processes, progressive, fields, retaliation, twice, allegation,
gotten, wrote, available, #1, professed, concern, insulting, continually,
boundaries, unable, various, sorts, email, knowing, reddit, terms, ability,
parent, premises, handful, ignorance, wtf, hurts, picking, lawsuit, pissed,
improve, faced, way:, fuckwits, perceptions, joke, admit, bet, faces,
co-worker's, presumably, cabal, improper, lancewiggs, improvement, conference,
korzun, outsider, harmless, union, 50%, jerks, legit, hardly, incompetent,
it'd, injustices, bulk, hmm, dramatic, textbook, paying, vendetta, plain,
harder, cast, policies, wild, voice, mistake,
http://www.bhorowitz.com/how_to_minimize_politics_in_your_co, characteristics,
keithpeter, disappointing, reads, bias, chasm, hyperbole, rtpg, severity,
perform, fallacies, potentially, grows, entitled, romantically, fairly,
reversion, logic, coder, husbands, persons, frequently, overt, hr's, mentally,
people', minimize, floor, spent, nebulous, practices, inability, stating,
morons, liked, devnonymous, financially, gojomo, it’s, unreal37, excited, gave,
explained, aspects, lacking, evaluate, breaks, burden, vacuum, necessary,
helpful, admittedly, bigotry, sexists, adria, audience, steps, nose,
jusben1369, oneeyedpigeon, trainee, outnumber, understood, shes, demeaning,
recognition, confusing, gross, perverse, confirm, no-management, anecdotes,
reach, disparaging, defensive, crap, gained, comparison, bills, rare, freedom,
violence, discussed, stretch, ensure, kyberias, automatically, communication,
spreading, balanced, pointless, technically, bothers, transfer, fight, suit,
assumes, offer, reminds, properly, gain, removed, directed, wish, ui, mature,
infants, retaliatory, irish, problem:, figured, defined, proven, danielweber,
annoying, unwelcome, compared, nonetheless, amounts, whereas, excuses,
republic, outperform, incredibly, separate, intent, persecution, describing,
died, socialized, –, readership, drawkbox, departments, posts, embracing,
resolution
===============================================================================
Total unique words: 2013
Total words: 23840
===============================================================================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment