Archive for April, 2008

On openness and privacy


This is a draft. I’d like to refine this essay – I’m sure there are places where the wording is awkward, where arguments don’t make sense, where things can just be said better. Please leave your thoughts – and your revisions – either in the comments here (which I’ll incorporate into the wiki version), or directly on the wiki version itself.

On openness and privacy

I’d like to talk about openness again today – on openness and privacy, and what the terms mean and how they intersect in the context of open-source development.

In particular, I’d like to talk about how openness and privacy do not oppose each other – and how, in fact, working on one will actually benefit the other. This might sound strange, since one is about sharing information and the other is about not sharing information. However, how and what type of information is shared in each case is what allows the two to be nearly symbiotic.

First, what is openness?

I’ll describe it here as free (libre and gratis) access with the ability to understand and utilize a resource.

Note the caveat on “ability to understand and utilize.” If you put something on a high shelf and allow anybody to take it, it’s “freely available to all.” But it’s not equally accessible to all. And while you can never make anything equally accessible to everyone, there are often things you can do to make it more available to a larger number of people. That’s part of your responsibility if you are sincere about making things “open.”

I want to emphasize this – having your stuff “free” and “out there” is not enough. Sometimes programmers tag a bug as “worksforme” to mean “well, I could do this, so therefore the bug does not exist.” This works in software, but it does not work in life (which is more fuzzy and much harder to debug, and runs on over 6.60 billion different kinds of processors as of right now. For many things, worksforme is a terrible justification for tagging something as “wontfix” unless you’re completely sure the generalization of worksforme == worksforall is true.

This is your responsibility as a maker. To make change with the things you make, people must use it.

Now, what is privacy?

I will describe it here as the ability to choose what information about yourself you wish to share (or not) with whom, and when and why. The ability to be anonymous is part of this. The ability to create and share and own your own identity is part of this. It’s tied in heavily with the notion of ownership and control – that you can shape yourself and what we know about you, and that this is your right (to some extent defined by law).

Note that privacy is about you. It’s possible to maintain your privacy and still be open about the work you do, so long as this work is about something outside yourself. You don’t need to share your phone number in order to give a solution to a math problem, or tell people how old you are, or where you’re from, or what politics you do and don’t support. You can even build up a separate identity – for instance, with a pseudonym – to preserve your other (usually “primary” or “real-world”) identities while still building up a track record for the “open” work you do.

Openness and privacy are not opposed.

We’re starting to see here how they’re similar, and actually aligned. In order to be truly open, information needs to be available and usable by people who want to preserve their privacy.

You can’t say “well, anyone who’s interested, just contact me personally.” That’s not enough. Some people will not – can not – contact you personally and ask. The barrier of having just one person knowing that they’re doing something can be too high. They might not have a means of getting back your message. It might be dangerous for them to leave a trace – if you could be attacked or killed for doing something, you probably won’t contact someone you’ve never met for further information on it. They might be shy or scared of wasting somebody else’s time. (You know the little kids who never talk, but who’ll pick up a toy or a book you leave out on the table when nobody else is watching, and then become engrossed in playing with it? Those. They grow up*.)

*I did. (In other words, this worksforme. ymmv.)

The knowledge that your privacy is safe, in turn, promotes openness. When you’re not afraid to share, and when sharing doesn’t hurt you – when it helps you – you tend to do it more. When you can share things anonymously but still listen back to what people are saying in response without you having to reveal you are the author, your work becomes about the work, and not about you. It doesn’t divorce your work from context – all works still have a context, and are undeniably written through the lens and frame of mind of their creators – but the context comes from people; the context is not itself a person, and this helps separate creator from creation so we can judge the work on its own merits.

This last bit is a loaded phrase. Sometimes knowing more about the author’s identity makes a work “better” to some people. I think this is important, but I also think we place far more importance on it than we should (just because somebody said something worth listening to before doesn’t mean that everything that issues from their mouth henceforth is gospel, to exaggerate a trend). New York Times Bestselling Author! Well, good for them. But is their new book any good? There is a study – I am trying to find it again (help welcomed) – that used scholarly citations to rank the “goodness” of a paper. They found the people that published “good” papers (cited by many other papers) were not more statistically likely to produce a “good” paper (in other words, they had the same hit-to-flop ratio as many other scientists). They just wrote more, and so they had a larger number of hit papers than the rest.

Openness helps us with this type of evaluation, because when we have the work available for us to judge for our own selves (instead of trusting what “authorities” on the subject say without our own critical thought on top of that). When we separate the work from who made it, we (1) can actually make our own judgments in the first place, and this (2) depersonalizes the conflicts in opinion that inevitably follow lots of people saying what they think of something. And once again, privacy – the ability to withhold information about yourself from judgment (or submit it, if you want to share that you are X, who has credentials in this field) – is crucial to this dynamic.

On building trust

The synergy of openness and privacy are needed to build trust.

Trust is an important thing to cultivate and preserve, and I believe that making information open and accessible to those involved in the conversation is a huge part of building that trust within the group you’re working within. Makes sense, really – if you can’t communicate, you have no information as to whether or not you want to trust somebody else in the first place. Now, this should be a “duh” thing, but it’s not – sometimes we forget that we cannot hear the people who can’t join the conversation in the first place.

Make sure your conversation includes the people that it really should – not just the ones who speak up first and loudest. Make sure the people you are talking to are fully aware of the terms of the conversation – that it is crystal clear what can and can’t be shared (best done by specifying a default, and then making a clear and obvious way to mark things otherwise).

Both are incredibly hard in practice, especially when the you-know-what hits the fan.

At TOPP, there’s been a lot of thought and conversation on the difference between open source as-in-license, open source as-in-accessibility (in the sense of users being able to find/easily-run/easily-modify the software – is the code gnarly, the application easy to use?) and open source as-in-information-flow-and-culture (is there a volunteer community? do they know what’s going on? do they drive what’s going on? what’s the relationship between “official employees” of the project and volunteer contributors?)

Likewise at OLPC. Communication is incredibly hard to do. From the “inside,” it seems obvious, and sometimes annoying – people are knocking at your door, demanding things you think they’re misinformed about. Why don’t they understand you’re too busy working to solve the problem to tell them about it? Why won’t they go away? We’re hosed! We can’t do anything about this!

Well, no. You can.

You can put out a sign saying “WE’RE HOSED. We really want to talk and listen to you, but we can’t right now – we realize X is a problem, and we want to sit down and talk about it. Could you please do us a favor and hold your horses and your speculation until this date, when we will set aside our time to dialogue with you in such-and-such a forum? In the meantime, we are buried working on the problem – we will fill you in on what is going on when we sit down and talk. While you wait, here are some things that you can read and do…”

That’s open. That preserves the privacy you have to keep the things you’re doing (including potentially sensitive things that can’t go to the public) until you can figure out what you do, in fact, want to tell people. You can be open about the fact that you are exercising your right to privacy – and make it clear that this is not because you’re mean, or that you don’t trust others – but because of other factors, whatever they might be.

I note here that I do this very poorly myself, because when you are hosed, it’s tough to pull back from the deathcrunch and swallow your pride and put out a sign that explains how you… well, can’t deal with things as well as you would like to. But it does keep you honest. And keeps the lines of communication open. And perhaps that helps you respond a little better than you would within a vacuum.


and back into abundance!


Oh noes. By taking notes in lecture classes, we infringe on copyright? That’s just ridiculous. Dave Wiley (in the link above) discusses it more fluently than I can here.

DJ is secretly a chef. I’d like to try this guacamole variant sometime (the premise: if it works in margaritas, it will work with guacamole).

Also, Python interactive shell tab completion? Thanks, Josh! (One of my favorite things about being at TOPP: I learn about neat meta-tools every day, and grow slightly more effective at using my computer for Great Justice every time I learn things. Seriously, how did I go so long without using regular expressions for more than “ls *.jpg” ?)

And man, the world is very different once you can “overhear” conversations (for me: blogs, but moreso IRC channels. Why did I not learn about these years ago? I’ve never overhead conversations before – they reveal all sorts of tiny, untaught, tacit things that you can use to navigate more surely through a world.) I’ve said this many times before. I’ll keep on saying it again. When you grow up devoid of conversations, the appearance of people you can talk to and forums that you can understand group discussions within is like a magic world you can not ever take for granted.

Reposting T.S. Eliot:


Endless invention, endless experiment,
Brings knowledge of motion, but not of stillness;
Knowledge of speech, but not of silence;

Where is the Life we have lost in living?
Where is the wisdom we have lost in knowledge?
Where is the knowledge we have lost in information?

The lot of man is ceaseless labor,
Or ceaseless idleness, which is still harder

I say: take no thought of the harvest,
But only of proper sowing.

I need more poetry in my life. I’ve started writing (sci-fi) again. I feel a need for music; I have not played an instrument in months (I sing, and find myself working out more a capella arrangements on the train – currently songs from Rent.) I need physical motion – dance and martial arts, and maybe someday rock climbing. Life is abundant and just full-to-bursting, and it’s good – a few days ago I was stuck in a depressive spiral of “dammit, I’m not going anywhere,” and tried to consciously kick myself back into a non-scarcity mentality.

Apparently the best cure is to hang out with some awesome people. When they start talking about the fantastical things they’re working on and learning and the trips they’re going to take and how they’re going to change the world, you get all fired up as well, and realize “hey, I can do that too!” and happiness ensues.

I am incredibly fortunate to have friends that continually inspire and challenge me. I’m not sure what I’d do without them.


On registration, patience, and the Met


The registration-over-time graph for an event with hackers as the primary audience. In reality, the intersection between the curve and the deadline-line is much lower, and you never actually reach 100% (in other words, this picture is hopelessly optimistic.

Now, patience and persistence. Yesterday while walking to the office I passed a woman painting a gas station and the three buildings surrounding it on three sides. It was spectacular – each individual brick was painted in a different set of hues, so that it blended into a kaleidoscopic rainbow sunset scene – and there were thousands of bricks. Each painted. In multiple colors. Carefully. Maybe 3/4 of the building surface visible was covered with these bricks.

“How long have you been working on that?” I asked her when she turned. “Over a year,” she said.

I wish I had that kind of patience. I really do work best in sprints – with flexible scheduling and slack to spark up on new ideas – but my ability to do the same thing seriously every day… sustained concentration on one thing, for me, is hard. I can do something for a long time, but not regularly. I can do something regularly, but not for too long. (Yes, my nomadic trends have made it difficult to do anything regularly. Hush.) It’s nice to know better how you work best, but I still need to keep pushing myself to work in ways I find uncomfortable, because… well, how else do I grow?

And finally, the Met.

It’s big.

It’s very big.

And full of art. Words fail me here. I thought I was in heaven. They had an exhibition on Chinese painting and calligraphy! The best part: I was looking at a scroll and realized that I could read it. That I could look at this old scroll and tell that the poet (whose name I couldn’t read, but eh) wrote it in February, that he was talking about how in the past fall they had owned some geese… I didn’t grasp it all, but I could follow scattered bits throughout the text and go “I understand!”

And then some beautiful, thickly textured photographs of New England parks, with fountains of leaves drifting before stone bridges, and branches thrusting up against the picture frames, and swirling gelatinous water with autumn foliage reflected in it – ahhh.

And so I walked on air all the way down to Vietnamese food (and really awesome red wine) with my TOPP coworkers, during which conversations ensued on topics like how Marxist theory can help explain the differences between hackers and hipsters and bobos and yuppies (the model Seb came up with was a 2D plot of informational vs procedural complexity in their conceptions of themselves and of the world).

It was also decided that I (among the TOPP denizens) corresponded most closely to River Tam in the TV series Firefly, and that if a movie came out entitled “Mel Chua Beats Up Everybody,” it would be awesome.

That was last night. The night before was pretty awesome too, making more vegetarian Filipino food at Sumana and Leonard’s apartment, which also featured pear mead. Also, did I mention I love sed?

It’s one of those fantastic times in life when you look up and realize – again, but you know that it’s still a recent thing – that there’s no ceiling any more. That you can go do anything. That there’s a world out there for you to dance with. And that you’re getting better at it by the day.


Braindump in scattered shards


I was completely taken in by Doug’s prank at TOPP today. (Fake “Out of office / work from home” emails from almost everyone before I’d reached the office in the morning.) Mad props, Doug.

Rent. I saw Rent. On Broadway. With I.House people. Wow. Wow. <Brain explodes here.>

For MetaOlin folks: “All models are wrong. Some are useful.” From this talk on being one of the 5%. I want to do that, but… for what?

(C’mon, Mel’s thought-coherence. Where did you go? You are not here tonight. I will speak in simple sentences so as to not confuse myself right now.)

If you’re of the scientific bent (or like motorcycles), read this paper snippet that Tim found in the Journal of Applied Physiology. I laughed so hard that I was in danger of choking on my chocolate soy milk.

I’m an unconference fan, and found these notes on ecocamp (from the midst of yet another event planning discussion – I’m finding that I really like it) to be insightful. They’ve done some things like “no presentations” (!!) that I’ve never seen at an unconference before, but want to try next round.

(C’mon, Mel’s usual habit of placing statements in a broader context and adding insights on them instead of simply repeating with vague “it is great!” descriptions and providing links. Where are you? Not here tonight. Mel is too tired.)

I’m better at getting other people to write code than I am at writing code myself. Should this change? Does it make sense for it to change?

I dearly wish that I could take this class. I think I’m at the point where something like it – a short, intense class on things I’ve vaguely seen some things from before, but haven’t really made-click in my brain – would seriously solidify and quantum-leap my Python knowledge. I also want to learn how to teach non-school classes (what do they call those? professional development?) because the audience of busy working people is one that I’m very unfamiliar with – hurrah for comfort zones and pushing out of them. It’s far more than I can afford right now, though, especially with a plane ticket.

I wonder if they’d accept a week or two of “work my butt off” labor in exchange for a discount? Even just the plane tickets would be a stretch, though. And – and really, it’s not like I can’t learn this stuff in other ways, and… I should be inventive and creative enough to do it. (C’mon, Mel’s-learning-fu. Where are you? You can do this.)

Sinigang sa bayabas (a sour Filipino soup) is delicious even when firm tofu replaces seafood (vegetarian-style, yo). Kaldereta, on the other hand, is way better with meat. Replacing beef with ripped-up frozen veggie burgers is… suboptimal. Filipino cuisine is seriously the opposite of vegetarian cuisine – perhaps they’re tied with churrascarias, but seriously, that’s it.

The Story Jam was mindblowingly great, but I haven’t yet processed everything – and I have less than 2 weeks left at TOPP, and lots to cram into that time.

Hello, Mel’s rapidly mounting sleep debt. How are you? Beginning to subside? Ah, good.

My brain is really scattered out right now. I’m happy, but exhausted and all over the place. I’m going to turn off my computer, walk upstairs, and just sit quietly and think for while, and then sleep. I’ve definitely been shortchanging myself on alone-time, thinking-time, and just plain ol’ Mel-time; I get jazzed up from being around a lot of awesome people, but it also drains me, and I do need solo stints to really recharge. Sometimes I just need to get out, walk around, listen, and be alone.

I’ll go do that now.