It's easier for someone in my position, after working 20 years in this field to talk about morals. I can disagree with the choices my employer makes. In fact, I can walk away. But I remember the dilemma I felt I was in, earlier in my career.

The lead developer stood behind me while I was working on a feature and asked me to make a div clickable. That's it. Technically, it's the simplest thing you can do. But, I hesitated. He watched from behind as I tabbed through every application on my computer, doing everything but what he asked. "Just make it clickable," he said again.

I have made divs clickable a thousand times in my then short career, I knew that html standards were merely a suggestion. But this one rubbed me the wrong way. Instead I said, "I already have an anchor tag below, the div doesn't need to be clickable."

"The fuck you're talking about? Just do it."

We got into an argument, and I ended up doing exactly what he said. A little after I pushed my code, he revisited my code and added a slight delay to my click event using setTimeout to disconnect the user action to what occurred after.

If what I'm saying sounds a bit vague, that's how it was framed at a time. We had disconnected the technical ask, clickable div, from the actual feature to make the whitespace on the page clickable. Let me make it even clearer.

Have you ever used a coupon website? You buy something on a website, let's say nike.com. When you get to the checkout cart, they have a little box that says "enter coupon code for a discount". So you scour the web to find a coupon that will help you pay less for your purchase. You land on our website where we offer a dozen coupons, but they are all partially hidden. The section says "click to reveal". When you click, some random popup appears, then the code is revealed for you to copy and paste and you go on your merry way with a discount.

Everything sounds fine so far. What you don't know is that the coupon website gets credit for the sale. A portion of the price you paid goes straight into our pocket, whether you got a discount or not. We get credit from the referral, that's how affiliate marketing works.

So why is making the div clickable, or the whitespace clickable a big deal? Because it captures accidental clicks. The company doesn't care if they help you find a good discount or not. In fact, they don't even care if the code works. They just want you to click and for that popup to open so they can get the credit.

My task was framed as a technical request, instead of outright saying "trick the user into clicking." When the Honey scandal surfaced, I was confused why it was news anyway. Deception in affiliate marketing is a standard.

Very often we disconnect our work from the real world consequences.

Back in 2019 I met this girl at a friend’s birthday party. She worked at a bank in the software development sector, and told me about the project on which she’d been working. Their system collected data from various sources on people applying for financial services (e.g.: loans) and would indicate if someone was eligible, or raise a red flag. In the latter case they would have to deal with substantial additional bureaucracy, and often times would not be able to access these services anyway.

She seemed quite proud of her work, and told me her team had demoed it the previous week in front of the whole office. They’d shown the report that the system generated for each person in the team. In her case, the system flagged her as “dangerous”, and she was not eligible for a loan. Her grandmother was from Iran, and because there’s frequently cases of money laundering or other irregularities in Iran, she’s immediately flagged too. Despite her being a Dutch citizen, born and raised in the Netherlands, and working in this Dutch financial institution, her bloodline was “too risky” for her employer to lend her money.1

I was confused, and honestly, heartbroken. This person was telling me how proud they were of their work, building a system that discriminates them based on their bloodline. I questioned what she thought about it, and she explained “well, the rules are there…” —she paused a few times— “the rules are there…”. I remained silent and she eventually finished her sentence after repeating it a few times “the rules are there to protect us”. Even though this was six years ago, every time I remember this situation it brings me great sadness. Here was a person who’d worked hard to build a system which would discriminate against them, and yet stood proudly defending their work.

We don't see it as our responsibility to question the system. We are happy to do the work as long as we don't see the immediate consequences. I feel this whenever I see flock cameras mounted in the street. Someone had to design them, write the code, test them, ensure that they work to spec. Someone had to install them. These are people doing a good technical job, yet I'm sure they wouldn't be happy if they were tracked by the very system.

This is why I was mad when Anthropic wrote their manifesto saying they are against tracking citizens, as opposed to non citizens. You don't get one without the other. We track everyone then discriminate later.

This is why I'm against age verification systems, no matter how technically impressive the solution is. Because in the end, I'm the one who has to upload my ID to a system that I cannot trust.

With AI, it's even easier to disconnect your day to day work from its consequences. I understand it's much easier to ignore these things when you are just getting started in your career, but eventually, you have to voice your opinion.