1

Multi-armed bandits are wonderful and have lots of potential applications. However, I don't know many companies or real-world practitioners who have implemented bandit algorithms.

  • What are some examples of multi-bandits that are up and running? By this I mean: An organization (company, government or whatever) has implemented the bandit. And the algorithm is live, performing explore/exploit and touching real-world decisions that change something (large or small). In the real world.
  • Refute this claim: "Bandits are an academic novelty. Despite attractive theoretical properties, practitioners have systematically refused to adopt them in practice since their invention in 1952."

Note: I'm not asking for potentially good (new) uses for bandits. There's already a question about that, and I agree there are lots of potential applications. I'm asking what anyone actually has used them to do. Lets list the biggest and most impressive applications!

kjetil b halvorsen
  • 63,378
  • 26
  • 142
  • 467
ABC
  • 409
  • 3
  • 7

1 Answers1

2

Multi-armed bandits are commonly used. They were used in Google Analytics and until recently the linked post was a part of the official documentation, but they probably switched to something else in the meantime. Washington Post used them for automated experiments on content placement. Here you can find a presentation by Netflix on how they use them for recommendations. Polish Onet.pl site engineers used it for content recommendations. They are used by Stich Fix fashion e-commerce. Notice that most of those resources are few years old, so not much of a novelty. If you google the phrase, you would easily find many more examples.

Tim
  • 108,699
  • 20
  • 212
  • 390
  • Is this the best we have? I find it underwhelming. The Google Analytics link seems out of date. The Washington Post article (and others) sounds like a science fair report instead of a mission-critical business application. They also seem like very low stakes. The Netflix application also seems like a science fair project, although somewhat more legit. How much revenue does this really affect? – ABC Aug 02 '21 at 14:27
  • You asked for "some examples", so I gave you some examples. You can easily find many others, also from other industries. – Tim Aug 02 '21 at 15:36