Serenity and compassion in trying times

Be happy again: Normal looks different. We’re all currently in an abusive relationship with a narcissist. We’re all getting fucked over by this one person who exists at the boundary of evil and ill, and the other people who have joined the ranks. But this won’t go on forever. The bad feelings aren’t your fault, they’re not natural, and they won’t last forever; and in this case, there’s even a kind of relief valve, because it’s very easy to identify the exact cause of the bad feelings. It’s very clear that there is a specific cause. It’s not like “I’m depressed”, where it helps to put a label on it and externalize the cause of your suffering so you don’t blame yourself, but then you’re still left with no recourse against “depression” as a nebulous entity that can’t be attacked and repelled. No, this time there is a group of real physical people who are doing this to us on purpose, using easily recognizable media channels and tools. They almost certainly don’t understand the full implications of what they’re doing: “Forgive them for they know not what they do”, but don’t let that interfere with stopping them. Protect and defend yourself from the aggressors, using whatever means are most effective for you, and then heal your own heart by forgiving them.
On a practical level, here’s what I think that means: Seek, and exercise, the serenity to accept the things you cannot change, the strength to change the things you can, and the wisdom to know the difference. Approach the world with the open questioning attitude: What needs to be done? What can I do to help, and what can’t I do to help? Maybe for you, the only thing that you can really do is to help out at a local soup kitchen. Help the world in the way that you can, accept that you are doing your best in an imperfect world, and limit your news consumption to the minimum you need to stay safe from direct threats. Tornadoes, civil war, etc., these things will be clearly announced, you don’t need to obsess over the news to stay basically safe.
If awareness of the information-sphere is close to your core identity, and you live and thrive in that realm, then perhaps you help the world in a different domain. Maybe you help organize protests, and you stay abreast of breaking news so you know what you need to organize. Or maybe you volunteer with a group of tech activists who are archiving climate science data so it doesn’t get deleted, and as part of this work you stay informed of the relevant news. Whatever your way of expressing yourself positively in the world, the important thing is to have enough self-compassion to accept that you’re doing the best you can, you don’t have to do everything, you don’t have to do it perfectly, and you don’t have to torture yourself about the countless other things that you aren’t doing, because you’re only one person.
Just to be clear: Bad things are happening, for real. Self-compassion does not include denial and ignorance. Escapism might bring you peace briefly, but that won’t last. Peace in trying times comes from knowing that you are doing the best you can, and also having the compassion to let yourself abide in that space.

Political trends visualization tools

This is a quick dump to get this out there, further discussion and documentation to be provided over time.

Google Trends doesn’t have a real public API; it’s heavily rate limited and so it’s hard to get even moderate amounts of data, and large amounts are right out. I worked with pytrends and scripted some delays and automation for downloading larger amounts of trend data for lists of search terms.

I used this to download just over a year’s worth of day-by-day trend data for (currently) 815 search terms, mostly related to current political events. Then I subjected this matrix  to Independent Component Analysis using Scikit-learn, which turns out to do a great job of separating out components with clear meaning on the events timeline. The components are displayed on a stacked plot with key political events labeled on the timeline. Some of the political events I entered a priori because they were obvious (like the election itself), and then some of them were entered after I researched archived news corresponding to peaks I saw in the plots. Note that many of the events in the latter categories were things that I wasn’t thinking about at all when I put together the list of search terms, but the ICA on the large set of terms brings out those peaks automatically.

Here’s an example plot with 13 components (choosing number of components for ICA is more art than science, 13 seemed to work well but other numbers did too):


There are a few other interesting trends graphs I’ve seen online. Here I’ve placed two big ones overlaid on that plot, for comparison of timelines. The first one is the plot of Alfa bank DNS server logs, which may or may not have something to do with anything nefarious. The second one is from Echelon Insightsannual promotional “year in news” article. Of course I don’t know their exact methodology (the point is that they’re selling their service, after all) but it’s likely that the trends displayed here are based on starting with the keywords labeling the peaks, rather than a component analysis of some sort. I would love to hear from someone who knows more.



The columns at the left are the top 15 terms, and bottom 15 terms, associated with that component. The positively associated search terms trend much more frequently when you see a positive spike in the associated component. The negatively associated search terms trend much more frequently when you see a negative spike in the component, or when the overall value of the component is low. The code automatically detects the spikes and rectifies the signal (ICA outputs are unpredictably, if not arbitrarily, scaled, so some ordering and rectifying are helpful) so the positively associated terms are usually more meaningful, but there are some interesting trends in the negative words too.

To improve visualization and insight related to the search terms, the code also generates word clouds of the top positively and negatively associated terms. Here they are in the same order as on the left side of the plot.


Although this is preliminary, I can make a few observations here.

  • The burst in Alfa Bank server activity is nicely bracketed by two events: Trump claiming Russia won’t go into Ukraine (also, Trump publicly asking Russia to hack Hillary’s email); and then Guccifer 2.0 tweeting to Roger Stone “paying u back”.
  • This article by Roger Sollenberger on how SEO is used for political influence describes gaming Google search results with a lot of fake posts. It uses the specific example of how the Seth Rich story started to get pushed after Trump brought alleged Russian spies into the Oval Office. In component 9 (sorry they’re not labeled, you’ll have to count from the top) you can see a predominance of terms related to both “trump_russians_oval_office” and “seth_rich”, which is consistent with that article’s demonstration.
  • Trump’s “grab ’em by the pussy” tape leaked on October 11. Shortly afterwards, a massive amount of anti-Hillary trends started and didn’t let up until the election. They dropped off almost immediately after the election.
  • The stuff glommed together as “wikileaks/hacking” in the Echelon graph is not completely clearly separated out in the components. Below, you can see what it looks like when I specified 15 components instead of 13. The Wikileaks email trend is clearer there, in component 10. Maybe I should have used that one as my main example instead of the 13 components.
  • In case it isn’t obvious, the component number 12 (13 in the 15-component plot below) represents the strong weekly periodicity in Google search trends due to the work week.



Please consider this a preliminary post, I wanted to get these tools and data out there. You can access all the code and data at my GitHub profile here. (As of this writing, 2017 June 6,  I haven’t added documentation yet, and I probably won’t have time to for a few weeks. Sorry!)

Here’s pdf versions of the big images above:


To do:

  • Stitch the word clouds and component timelines together into a single easy-to-view output
  • Label components
  • Single-word search terms are more frequent than multi-word ones. Consider ways to normalize this.
  • Look into ways to integrate this with Reddit data from @conspirator0

Democracy is on Life Support: Stay Focused!

Since the announcement of the special prosecutor, I noticed a new trend in my Twitter feed, which is dominated by #Resist-themed threads and people. Up to that point, there was an amazing unity, people coming together across the traditional liberal/conservative divide, recognizing in Trump a profound threat to America and democracy itself. After the Special Prosecutor announcement I felt a surge of relief and hope, as I’m sure everyone else in my Twittersphere did too. And then I started to see a large amount of Twitter traffic, sometimes very heated, debating the validity of certain amateur journalists who have become minor celebrities online. And this concerns me very deeply.
This is war, and for the first time in more than a hundred years, it’s a war for the survival of America. It is, to say the least, a very unconventional war. This is unprecedented sci-fi territory. You remember the declassified CIA/FBI/NSA assessment that came out in January?* It’s clear that Russia just struck a bigger blow to US liberal democracy than they ever managed to do during the Cold War Era. And that’s not even the biggest threat.
The biggest threat to America is decades of efforts by the GOP to undermine democracy. Make no mistake: after decades of gerrymandering, CrossCheck, Voter ID laws, disenfranchisement of convicts coupled with a profoundly racist court system, and more, democracy is on life support. Samuel Sinyangway reports on the rise of neo-slavery as a permanent prison underclass, sharing horrifying observations from the Louisiana capitol.** Mike Farb has done immense research uncovering MASSIVE vote machine hacking and fraud.*** The NSA has informed Congress that alt-right fake-news sites are, wittingly or not, a part of the Russian influence campaign.****
Even if Trump steps down; even if he’s impeached, imprisoned, even executed for treason… Democracy is on life support. All these shenanigans continue. We will simply have another, more stealthy fake president next time who is smart enough to keep his Twitter account quiet while he helps destroy America.
Things are not “back to normal” now and they will not be any time soon. The people of Syria don’t get to go back to normal life. The people of Afghanistan don’t get to go back to normal life. Even if Trump and Pence and Ryan and Flynn and Stone and Manafort and Page and dozens of others go to jail, war changes everything, and this is the first time we’ve woken up to the awareness that our own country faces an existential threat. This is not normal life and we do not get to let our guard down. True, no one in America is getting bombed, but we have a different kind of challenge in a different kind of war.
In this war, complacency is surrender; only restoring democracy is victory. I deeply believe in the quality of the American people. When ALL Americans have their voting rights and access restored and democracy once again represents the American people, THEN America will be great again. Restoring democracy is the ONLY front in this war that matters, and it’s a long way off, and it will be a slow hard process.
We need to work together. This time has been beautiful in a way: So many people have come together to share information and mutual support because they saw the evil represented by the Trump administration, saw the threat to America. People have come together across party lines. I am closely following people who are Bush admin staffers and conservative authors; I never would have expected this, five years ago. Everyone in The Resistance is here because they have good intentions. Of course it’s inevitable that some people on “our side” are confused, misled, useless, even counterproductive. That’s how humanity works; humans are messy and beautifully imperfect. That’s how social progress works: we’re united by a common belief in the possibility of a better world for EVERYONE; not by GOP-style “loyalty oaths”, not by Nazi-style ideological purity; not by hierarchy or enforcement. We’re united because we all believe in making everything better for everyone. It’s inevitable there will be disagreements in a community united by the big picture, rather than by enforcement and oaths. Embrace those differences as part of our strength, and don’t waste energy trying to eradicate them.
Inevitably, openness and diversity makes truth hard to find, because no one is locking things down. This is good! But, it’s important to stay grounded in truth, when there’s so much misinformation going around. Stay grounded, but don’t let that turn into ideological purity. Assess your facts with your critical intelligence, then choose whether to spread or debunk (and if you choose to debunk, do it with sources, not just emotion.) Assess your sources with the same skepticism, then follow, unfollow, mute, or block as appropriate. Save your bandwidth for spreading what needs to be spread; don’t fall into the trap of fighting against the noise. The internet is 99.9% noise and you will never change that, so focus on the upside, not the downside. Don’t get drawn into bickering and infighting; don’t forget that democracy is on life support, America is under attack from inside and out, and your freedom is no longer guaranteed.
In conclusion: Stay focused. #staywoke. Keep Resisting! Ground yourself in truth as well as you can; accept that will never be perfect. #MarchForTruth  #unhackthevote#Impeach45 and then continue to #Resist until democracy is restored.
****I saw video of this testimony but haven’t been able to find it again. Maybe this:
Or this:

Emolument lotion? Etymology fun time!

If you’ve been even remotely paying attention to America recently, you’ve heard the word “emolument” quite a few times, maybe for the first time. And if you’re really paying attention, you might have noticed that it sounds a lot like “emollient”… like moisturizing lotion.

So, you’ve heard the word “emoluments”, and hopefully it’s clear from the context that “emolument” means something like bribes and kickbacks: some kind of illicit payment for favorable treatment. Merriam-Webster says “the returns arising from office or employment usually in the form of compensation or perquisites”; saysprofit, salary, or fees from office or employment; compensation for services: Tips are an emolument in addition to wages.” That doesn’t sound like a word that means something unethical. But! We’re hearing the word in the context of “the Emoluments Clause to the US Constitution”, Article 1, Section 9, Clause 8, which reads:

No Title of Nobility shall be granted by the United States: And no Person holding any Office of Profit or Trust under them, shall, without the Consent of the Congress, accept of any present, Emolument, Office, or Title, of any kind whatever, from any King, Prince, or foreign State.  –ARTICLE I, SECTION 9, CLAUSE 8

OK, so this is where the “bribery” connotation comes in: In brief, the Emoluments Clause says that no “Person holding any Office” in the US Government, shall accept any foreign profit, salary, fees, compensation, etc. It’s obvious why: the Founders didn’t want the sovereignty of the new nation compromised by having leaders influenced by payments from other nations or rulers. If the officials in question might have considered the foreign power a threat, the payment might appease that concern and lead to more favorable treatment than what was really best for the nation.

Back to etymology. Our hypothetical official, he got bribed, and his concerns were mollified. Mollified means “softened in temper, appeased, pacified“, and the word is derived from the Latin roots “mollis”, meaning “soft”, and “ficere”, to make. So to mollify someone is to make them soft, etymologically. And “emollient” is also from the Latin root “mollis”, and still explicitly refers to “making soft”, because that’s what moisturizing lotion is supposed to do.

I was hoping that I’d look up the etymology of “emolument” and find the obvious connection I’ve implied above. But no, the Online Etymology Dictionary says:

mid-15c., from Old French émolument “advantage, gain, benefit; income, revenue” (13c.) and directly from Latin emolumentum “profit, gain, advantage, benefit,” perhaps originally “payment to a miller for grinding corn,” from emolere “grind out,” from assimilated form of ex “out” (see ex-) + molere “to grind” (see mallet).

Drat! That’s not what I had hoped for. “Emoluments” is cognate with “mill”, a grinder, because it was originally a Latin word for paying millers for grinding corn. (“Corn” is an archaic word for any grain, because modern American “corn” is native to the New World, and the Romans didn’t have it.)

But hold on a minute, we’re in luck. After some more research, I came across the longer and more detailed etymological exploration of the word “mild“:

Old English milde “gentle, merciful,” from Proto-Germanic *milthjaz- (source also of Old Norse mildr, Old Saxon mildi, Old Frisian milde, Middle Dutch milde, Dutch mild, Old High German milti, German milde “mild,” Gothic mildiþa “kindness”).

This is from PIE *meldh-, from the root *mel- (1) “soft,” with derivatives referring to soft or softened materials (source also of Hittite mallanzi “they grind;” Armenian malem “I crush, bruise;” Sanskrit mrdh “to neglect,” also “to be moist;” Greek malakos “soft,” malthon “weakling,” mylos “millstone,” myle“mill;” Latin molere “to grind,” mola “millstone, mill,” milium “millet;” Old Irish meldach “tender;” Old English melu “meal, flour;” Albanian miel “meal, flour;” Old Church Slavonic meljo, Lithuanian malu “to grind;” Old Church Slavonic mlatu, Russian molotu “hammer”).

Bingo! The Latin molere, “to grind”, is derived from the Proto-Indo-European root mel-, “soft”, by way of the sense that grinding in a mill starts with hard grains and results in soft flour. So as I suspected, “emolument” is cognate with “emollient” (and “mollify”), through a roundabout etymological path of linguistic evolution.

It was especially amusing to learn that in addition to this, “mill”, “mild”, and “mallet” in English, as well as several other languages’ words for “hammer”, “crush”, “bruise”, “soft”, “weakling”, and “tender”, are all also cognate with our host today.

I’ll conclude this essay by quoting the ultra-conservative, Reagan-worshiping Heritage Foundation‘s essay on the Emoluments Clause of the Constitution:

…Similarly, the Framers intended the Emoluments Clause to protect the republican character of American political institutions. “One of the weak sides of republics, among their numerous advantages, is that they afford too easy an inlet to foreign corruption.” The Federalist No. 22 (Alexander Hamilton). The delegates at the Constitutional Convention specifically designed the clause as an antidote to potentially corrupting foreign practices of a kind that the Framers had observed during the period of the Confederation… Wary, however, of the possibility that such gestures might unduly influence American officials in their dealings with foreign states, the Framers institutionalized the practice of requiring the consent of Congress before one could accept “any present, Emolument, Office, or Title, of any kind whatever, from…[a] foreign State.”

St. George Tucker’s explanation of the clause noted that “in the reign of Charles the [S]econd of England, that prince, and almost all his officers of state were either actual pensioners of the court of France, or supposed to be under its influence, directly, or indirectly, from that cause. The reign of that monarch has been, accordingly, proverbially disgraceful to his memory.” As these remarks imply, the clause was directed not merely at American diplomats serving abroad, but more generally at officials throughout the federal government.


Naming rivers doesn’t change the flow

Have you ever watched rain running down a window on a rainy day? Droplets merge into rivulets, they twist and stream around. Sometimes two rivulets come together, their flows merge and become a larger rivulet to the bottom of the window.

Have you ever seen a place where two rivers run together? Water flows off the land when it rains and into channels and then together and together and together and then eventually into the oceans. And at some places, a couple of those channels are both big enough that we call it two rivers running together.

For almost every single river on the planet, Humans have traced from the oceans up each river to each of those merging places, and at each Y-shape they decided one fork is the “real” river, which gets to keep the name. And the other one is a separate river, which gets called a “tributary”, and never gets to see the ocean.

This is reality: Water flows over the earth and through a vast network of merging channels into the oceans.

But humans are so obsessed with forcing nature into categories that they have gone over the whole planet and at every merging of two rivers they decided which one is to blame for the output river, and which one just ends there.

OK, I’ll grant this much: practically speaking, you have to call each river something, and this system is probably the best we could do for coming up with what to call them. But there’s a real loss if you forget that it’s all just water. The rivers are what they are; but if you forget something, then that simply means you’ve failed to understand nature very well.

You’re probably reading this as a spiritual metaphor or a philosophical musing, or some such thing. But I have a Ph.D. in psychology, not either of those. I’m writing this to point out that the way ordinary human minds work, we have a strong bias towards forgetting that everything flows together. When something happens, we want to know who is to blame and who was an innocent victim. We want to know who wins and who loses. We want to know what’s right and what’s wrong, who is good and who is evil. We want to know these things partly because we want to be saved from the anxiety that comes from not having neat clean answers; the anxiety that comes from not being able to classify, name, and control everything that happens to us.

Some people more so than others, so maybe you’re reading this and it doesn’t resonate with you… in which case, consider yourself lucky!

Remember that just like the names of the rivers are made up, so our names for any causal relationships are made up. Causal relationships are much less limited than our names for them. When we blame someone else for something that happens, then we give ourself the name of “tributary” and say that our role ended there. And when we blame ourselves, we cut off the others too. And neither of those is completely true. Yes, it’s practically useful to say that it goes one way or the other in the cases where it’s clear-cut, but you’re always losing information when you do that.



Are we living in a simulation?

This paper got some attention and amusement when it came out a few years ago:

Constraints on the Universe as a Numerical Simulation

Observable consequences of the hypothesis that the observed universe is a numerical simulation performed on a cubic space-time lattice or grid are explored. The simulation scenario is first motivated by extrapolating current trends in computational resource requirements for lattice QCD into the future. Using the historical development of lattice gauge theory technology as a guide, we assume that our universe is an early numerical simulation with unimproved Wilson fermion discretization and investigate potentially-observable consequences. Among the observables that are considered are the muon g − 2 and the current differences between determinations of α, but the most stringent bound on the inverse lattice spacing of the universe, b−1>∼ 1011 GeV, is derived from the high-energy cut off of the cosmic ray spectrum. The numerical simulation scenario could reveal itself in the distributions of the highest energy cosmic rays exhibiting a degree of rotational symmetry breaking that reflects the structure of the underlying lattice.

A friend brought up this question in a Facebook thread recently. Here’s my response.

OK here’s the thing. If the function of the simulation is to simulate physics, for whatever reason, and our awareness is epiphenomenal to that goal, then it would make sense to run it as a finite-element simulation like the cubic grid posited in that paper. However, on the other hand, if you ask the question “what would be the most efficient way to simulate what I seem to be experiencing” the answer is undoubtedly to have a neural-net-based simulation generating your own consciousness and feeding it stimuli based on an attention-driven sparse simulation of only the relevant parts of the rest of the universe. In that structure of simulation, there’s no reason at all why you would see any artifacts in the outside world because the outside world is generated only to an awareness-centric spec.

It’s also possible that it could be a hybrid, with a global universe buffer simulation used to provide an optimized sparse consistency across different minds’ awarenesses.

In any case, you run into the same problem philosophy has run into for all of time, which is that YOU don’t actually have any proof that the rest of us aren’t NPCs. The simulation has to generate a lot of information for you to feel like you are you, but it only has to generate an insignificantly small fraction of that amount of information for you to perceive me, so it wouldn’t really seem to be efficient to simulate me at the same level of richness as it’s simulating you, merely for the purpose of filtering out 99.9999999% of all that and feeding you the tiny remainder.

The standard response to that is “yeah, but it’s unlikely that you’re so special, so don’t fall into the trap of solipsism”. But that doesn’t actually make sense. You ARE absolutely that special; precisely because you have overwhelming, direct evidence for the presence of your own mental processes, and barely any evidence at all for the presence of anyone else’s mental processes. The part of the simulation that is YOU is special because it’s far and away, no contest whatsoever, the densest part of the simulation. You can argue with me all you want, but it’s prima facie that you’re experiencing you more than you’re experiencing me, so any objection you might make is pretty hollow.

Of course I’m writing this based on what I’m experiencing, but if you’re not an NPC and you’re reading this, then it applies equally well to you. And there’s no reason you should believe there’s a fully simulated consciousness here (me) if the only thing you’re experiencing is just yet another wanky out-there philosophical internet blog blather. So I’m not going to flatter my(potentially-NPC)self by claiming to be real.

Enjoy the ride


Ontological Depressive Realism

People take comfort in a wide range of philosophical, theological, and ontological beliefs, such as life after death or a loving and supportive deity, but scientific psychology is skeptical. The therapeutic tension can be resolved without needing to solve the underlying philosophical questions by ontological depressive realism: As CBT theory has recognized that unrealistic optimism can be a part of optimal mental health, this can apply to ontological questions of life after death, etc. This will allow the scientific and clinical community to work with the full range of possible beliefs and (purported) experiences without needing to accept, or even address, whether these things are based on any sort of objective truth.