Submind YouTube summaries
Thumbnail for Inside quantum optimization research

Inside quantum optimization research

Watch on YouTube

Video summary

Quantum computing presents a transformative opportunity for optimization research by addressing complex challenges where classical methods struggle with exponential search spaces and intricate problem structures. Optimization, defined as finding the best decisions to meet specific goals within constraints, is vital across industries like finance, logistics, and manufacturing, where even minor percentage improvements can yield significant leverage. While classical approaches generally fall into exact methods that guarantee optimal solutions but falter under complexity, or heuristics that offer good but unproven results for large-scale issues, quantum computing offers a logical alternative. Theoretical results suggest that by utilizing fundamentally different operations and representations, quantum systems can solve specific abstract problems exponentially faster than their classical counterparts, providing new tools to tackle cases where traditional heuristics are insufficient. A key example of this potential is the Quantum Approximate Optimization Algorithm (QAOA), which leverages adiabatic principles to transition from simple to complex problems while maintaining optimality. Unlike classical algorithms that typically yield a single solution, QAOA generates a diverse set of solutions from a distribution, empowering decision-makers to select options with superior trade-offs. This capability is particularly evident in multi-objective optimization, such as balancing cost against speed, where classical methods often rely on weighted sums that may miss high-quality trade-offs. Collaborative efforts have developed quantum algorithms combining classical techniques with QAOA to successfully identify the full set of these difficult trade-offs, a success demonstrated on 42 qubits where the simulated quantum approach already outperformed existing classical methods, strongly suggesting that scaling to larger hardware will eventually make it the superior strategy. To ensure that claimed advantages are genuine and not merely artifacts of simulation, experts have introduced the "Quantum Optimization Decathlon," a public benchmarking library containing ten difficult problems selected to provide a robust baseline for testing algorithms. This open-source initiative allows the global community to compare new approaches against established standards, fostering progress that often stems from innovative ways of representing data rather than just algorithmic changes. As research advances, multi-objective optimization remains a critical frontier for future quantum applications, promising to unlock new efficiencies in real-world scenarios where classical computing hits its limits. The discussion concludes by emphasizing that the quantum future is being built in the present, inviting viewers to explore additional resources and deep dives on platforms like IBM Research to stay informed about these rapid developments.
Read the full video transcript
So how can quantum benefit optimization? >> Optimization is is everywhere. >> It's like you're viewing the problem from a different angle. >> If you have this exponential explosion of your search space together with a complicated structure, then this is very hard to navigate. >> And if you throw the quantum computer on it, you can find those uh solutions that cannot be found with a classical one. Welcome to season 2 of the Coherence Times, where we [music] bring coherence to the entangled world of quantum computing. I'm your host, Ryan Mandlebound. Every other [music] week, I'm bringing you stories about how scientists, developers, and businesses are making quantum computing [music] a reality. We'll explore new research and development, highlight the latest advances in the field, and see how users are trying to [music] extend quantum to realworld problems. >> [music] >> I think a big undercurrent of business computing is how we can optimize things. We like to get the most stuff for the lowest cost. So I hear a lot of questions about how quantum computing can help solve optimization problems like the traveling salesman problem or the knapsack problem. But the answer is that things are complicated. There's a lot of interesting research suggesting that quantum might produce algorithms that can outperform some of today's classical optimization algorithms. So to tease that out, I'll be sitting down with two experts who can help us understand where optimization stands to get a quantum boost. [music] First, I have Stfan Verer, who's a principal research scientist and senior manager of applied quantum optimization research at IBM. Also joining me is Stephanie Reed Miller, a doctoral research from the ZUSA Institute Berlin, [music] which is an interdisciplinary research institute for applied mathematics and data inensive high performance computing. Both of today's guests also participate in a working group spanning institutions around the world that's working to build and test these optimization [music] algorithms. I encourage you to learn more about that group's work by visiting their new quantum optimization benchmarking library website linked in this episode's description. Maybe we get started with you Stefan. Um what makes optimization such an important problem for us to tackle? optimization is is everywhere. Um if you if you think about optimization, what what it is, it's it's finding the best decisions that um optimize a certain goal or towards a certain goal while taking into account certain constraints. And that's quite quite generic. Let's let's think about complete examples. We have uh in finance optimization where we want to optimize some investments given some risk or budget constraints. Um in logistics or supply chain optimization, manufacturing, we want to optimize um production schedules or order plans to meet uh demands while having like capacity, production capacity under control or cost under control. And um there are plenty more examples in in like uh a lot of different disciplines. And uh often we have the situation that a small um improvement that say by by a few percent can have a big impact because there's a huge leverage. Think about finance. If you manage a lot of um money and you make a 1 or 2% improvement in your expected return, that can uh have a a significant impact. So like a good top line would might be I have some currency, money, energy, something that uh I have to spend in order to do something. And I also have some amount of work that I want to do. Maybe I want to uh buy the most peaches of anybody or from all the different price of peaches or something. You know, there's a million different things I could either buy or use the energy to do. And so then optimization essentially asks what is the best way that I can do that? what is the most number, the best value, bang for my buck basically. >> And if you if we take the example that you have with the with the peaches, that also gives you another another important point. Um, often there's uncertainty involved because how many peaches you might get at the end of the season that depends on the weather. But that's something you don't have under control, but you have to make some some estimates to come up with a good model that describes what you want to optimize. And then that's what you solve and what you what you try to um approach with the with the algorithms that we are developing. >> Cool. And then Stephanie, what are some of the ways that we've been tackling optimization problems today with a classical computer? >> There are basically like two directions you can take. Um one is if you really want to have an exact solution, you really need the optimum and you need a proof that it's the optimum. Um this is one direction or you take uh the other one wi-i which is called huristics. In that case you're fine if you have a good solution and you don't have a proof how good it is and no guarantee how good it is but you know that usually from this method there is a good solution you can use and this is often used uh for applications where you have big problems that are hard to solve. Now of course we have in this exact and heruristics um uh also some new emerging things like um quantum or GPU and uh learning. >> So I mean basically for the sort of problem space it could be like you have an ocean of waves and there's an optimization problem where you want to find the tallest wave and you know that there's a tallest wave in the ocean but then then so you have a method that might be able to find that but then of course you also have it that's just you're just interested in surfing some big waves. So all you need is to know where the biggest waves where a place where there's some really big waves that you can be happy with. And how would you sort of what do the problems look like? What are the sort of algorithms look like and how do they differ between those two problem cases? >> I mean a typical exact method would be if you have a so-called linear program or a mixed integer program. This is basically just a technique how to formalize a problem and then you there are specialized solver who will give you um the correct solution. But for heristic you could for example just explore different areas. For example with your waves you can um travel to different regions and look where you think oh they are usually big waves. So I look in the areas where they usually are and if they are not I I look in another direction where I know they they are usually there. So um this is like a typical approach. And then um maybe I'll ask you Stefan like what makes classical like why is this hard enough that we have to go looking for other methods with GPUs and quantum >> many of these of these problems have a like a combinatorial element to it. Um say you have to decide whether you buy a certain product or not whether you turn on a certain power plant or not. Um so these are the simplest one where you have like this yes no decisions to to be made and the more you have of those the more possible combinations of those you have as well and in general that that number like the size of the search space scales exponentially. Now that by itself does not necessarily make the problem difficult but then some problems have a very complicated structure and uh um if you have this exponential explosion of your search space together with a complicated structure then this is very hard to navigate because like in the in the worst case you really have to go through all possible combinations and since there are so many of those you you can't and that's that's one thing that drives complexity of uh of a problem. >> So Stefan, what makes quantum like a logical place to look to solve this complexity? >> We we have um theoretical uh results that show that for all we know today, they exist problems that a quantum computer can solve exponentially faster than uh a classical computer. Now these problems um are relatively abstract and they are usually like uh quite carefully constructed. So they're they're pretty artificial problems but they like the theory shows that they exist such problems where quantum can help with classical and um now since quantum works completely different it gives us new tools gives us new operations that we can apply gives us new ways to build algorithms. Um and together with this with this knowledge that they can be better in optimization, this makes it very exciting to now take this and search for for new algorithms that work not only for this abstract or artificial problems but really for the problems you care about. It's quite difficult for a concrete problem to say uh a priori whether quantum will work or not. However, it's essentially the same classically as well. So for many interesting practically relevant problems um like like the the finance or logistics problems I mentioned earlier we we cannot say usually a priori that a um classical algorithm works well. We have to rely on these uristics that Stephanie mentioned where we essentially have to we have to try them on the problem and see how well they they work. So this is how classical optimization um uh essentially works for for practically re relevant problems and the same is true for for quantum. So we know there exist problems where it's better. We know it can do things classical can't. But for a concrete problem, we actually just have to try and see what works best. >> I see. I hate to go to the sort of like we have the hammer but not the nail problem, but I think it's almost like we have this toolbox of like really amazing tools that have been tried and tested in places that are mathematically and theoretically interesting, but now we need to actually find those problems where those tools fit and they work. Um but the funny thing is that like with classical and quantum we have essentially like very similar toolboxes where we actually still are not at the point we have these amazing quantum tools that we know work really well for these sort of theoretical problems and then we have these you know classical tools that we already know don't work as well as we wished for the problems that we're already using them for. So the question is like do these cool quantum tools work better than these sort of not great classical tools we're already using? Exactly. Like we we uh back to your analogy um we do know that uh some nails exist where you need that hammer. Um and we we know that some other nails exist where the tools we have classically don't work. And so now we want to we want to build these quantum tools on top of of what we already know to to solve the problems that uh that are left over from from classical optimization that are still hard. whether it's is still a margin for a quantum advantage, still a margin for further improvements. >> And then Stephanie, can you tell me what's exciting about this? Like what got you into the field that you'd be interested in studying like something specific like this? >> Yeah, I mean I'm coming from the classical mathematics. So um it was like one day my supervisor came in and was uh talking to me about um how he works together with Stefan and how excited it is and he said you like multi-objective optimization they are now doing multi-objective optimization with quantum now you're also doing quantum and this was of course at first a little bit scary for me um but uh then it got I was so excited about it and I joined the group and it was uh yeah really excited to to to to see how this new hardware I knew nothing about before can um solve problem with a different view like it's like you're viewing the problem from a different angle >> what about like when you first saw like the quantum computing mathematics was it like surprising how did it actually feel to start seeing these these quantum algorithms >> it was uh surprising because I I had really no idea before and then I um and I saw and I think there are a lot of aspects I still don't really understand but um the way I I see it now is that yeah you just have to view at everything from a different angle maybe find um the the the type of algorithms that really use this new hardware and this is cannot just be the old hardware um but faster but it's a completely different way and this is so exciting for me >> uh and Stefan how about you I mean you've been in this for a while what what sort of first got you into I mean my background is also originally in classical optimization. I worked on optimizing uh our supply chains and and and logistic problems and things like that. And um then like it's now 10 years ago uh IBM built this first quantum computer. So we had this first small quantum computer in the cloud and it was was available and we could play with that. And um back back then I already looked into it a bit. But uh I was uh still working on our um our classical optimization problems. But then one day I also had the opportunity to to join some discussions with a local group that worked on the hardware and um was then asked to to to to join the discussion on suppose we have these devices what are we doing with them? So it's kind of the the same questions we we kept asking ourselves from the classical side. Now we're we're raised again from a different perspective and um that was that was very interesting and it it um yeah led me looking into quantum computing. I I read into that and uh then uh we started to build the the team in Zurich um looking into applications of quantum uh quantum computing more generally not only optimization but of course that was my background so that's where where I always was was involved that was uh now 8 years ago or so we looked at the same problems but now with a new tool and that was kind of what sparked my curiosity like uh we we were struggling to solve these problems now what can we do with these new approaches But does this new new type of math in a way or at least new to me um what what where can this help to solve the problems we were struggling with already for a uh yeah for a long time. >> Can we pick an example of like an algorithm that we're using today maybe an early algorithm like you know the QAOA for example um and talk about why it or how the mathematics looks different from a classical optimization algorithm. the the way we we represent uh a problem and the way we then algorithm works is is fundamentally different. So in a way we use different types of representations and um a algorithm that illustrates that quite quite well I think is the quantum approximate optimization algorithm QAOA. This is an algorithm that is derived from a um from from a a physical principle that's adabatic analing. Um and what what you do there is essentially you start with a very simple problem that you can easily write down where you can immediately write down the optimal solution. And what you then do is you you take a quantum state, you prepare that state such that it represents that simple solution and then you very slowly transition your problem and you [snorts] make sure that your system always stays in the optimal solution of that of that uh changed problem. So you very slowly change change the problem of interest and you do this until you reach the problem you actually want to solve. And this ideabetic principle um or ideabatic theorem that that tells you that if you do that slowly enough then you always stay in the optimal solution and you end up in the optimal solution of of your target problem and um I think this this kind of approach is something that is not really um possible uh classically in the same way. So it's really a different uh it's a different way to represent the problem and then and then um work with this uh solution space and uh the QAOA is now a very rush approximation of this idea instead of doing that very slowly which can actually be exponentially slow um it does this with a very um just a few uh big steps if you want you optimize the steps a bit but um it's just a few steps and the idea is that you can implement that on today's quantum computers um which have some noise so you can't do arbitrarily complex calculations and it could be shown for certain algorithms that this achieves certain performance guarantees and so it's a very widely used and studied uristic um to try uh solving optimization problems on today's quantum computers and uh it's um I think it's it's quite interesting because it's it's one of the example that we really can try today already and learn how well things work. Um where are bottlenecks? Where do we need to improve? What kind of problems might be better accessible to to uh these type of algorithms? What problems are further away? How does this thinking about quantum sort of change your view on classical algorithms and sort of change your understanding and how you actually go about creating algorithms for an optimization problem? I think like the main uh yeah difference for me was um that if you solve or use an algorithm to solve something in classical algorithms you usually usually get one solution um out of it and for the for example for the QA in the end we got a sample from a distribution so we get not only one solution out of it so a whole set of solutions um that are potentially good, probably good. And uh usually you would like still go for one of those solutions, but we noticed that we can just use this whole set of new solutions if we need several. >> Let's talk about multi-objective optimization now. So can you tell me about what that is and how it differs from class, you know, from a typical one variable optimization problem? >> Yes. So um for a classical optimization like a single objective optimization problem you just have one goal like in one direction you go to optimize um and for multi-objective optimization you have several directions you want to search in the same at the same time and if you go for several directions at the same time there is not usually not one optimum but there are several um optimal solutions um and you need a new concept to compare those solutions. It's called parto optimality. And this means basically a solution is PTO optimal if you cannot improve it in one direction without worthing worsening another direction. And the goal is to find all those parto optimal solutions. Um maybe you need an example to better understand this. For example, if you I mean my objective optimization is everywhere on your daily life. For example, if you want to uh buy a train ticket, you can go for the one that is the cheapest or you can go for the train ticket that um where you have to change trains um as as few times as possible or you can go for the ones where you um arrive the fastest as your at your goal. Um and maybe if you then have to decide you go for none of these options but something in between that is very good in time but also does not cost that much and to find all those solutions that are all kind of optimal in their own way. This is multi-objective optimization. >> I see. And so there's essentially if you imagine these can be like on a graph there's like a line that connects these various solutions, right? and you're looking for sort of that specific boundary between the two so you can get that optimal in both directions with your different trade-offs. >> Yeah. For um for if you have two um uh two objectives, this would be the case that you have like a like a relation between those two that you can imagine like a a graph like a 2D graph. But um if you have several objectives, the solution space becomes um like a multi-dimensional object. you actually came up you has worked on a quantum algorithm that helps to tackle this problem right I'd love to talk a bit about that and how it works and Stephanie you can tell me about about it because I know you were on this paper >> yes um so uh the goal there also is to solve a combinatorial multi-objective optimization problem and we take it from two sides from a classical and from the quantum side um from the classical side we use something that is called gallerization which is a very like an easy uh way to take a multi-objective um problems even for like wayward world applications and so on. The idea is that you take the multiobjective optimization problem and you transform it into a set of single objective problems. Um, and that you do by combining the objectives. Um, and then you do it several times to have different combinations of the thing of the objectives. Um, this is called weighted sum approach. Maybe you heard of it. Um yeah, we did this from the classical side and then from the quantum side we used the QA algorithm you were already talking about. Um and then we combined this and I think the the really nice thing is is if if you would do the same thing without the quantum computer just with a usual classical computer you would get a subset of the um solution set but not all of them. There are some that have a specific property you cannot get when you do this classically. And if you throw the quantum computer on it, you can find those uh solutions that cannot be found with the classical one. You get more of the solutions that maybe even all possible solutions. And I think this is like a pretty nice uh result. >> So then how would that um as like a user of this algorithm, how would that sort of um kind of be a material benefit? What what what would I gain from having more of that solution set? Yeah, usually those uh solutions you are that are more difficult to find um sometimes have a very good tradeoff between the different objectives. Um usually if you're a decision maker for um I don't know a big industry or something, you would never go for a solution that is very extreme in the in one direction but then very bad in the other. you would want to have like a good trade-off and those solutions we cannot find if we do the same algorithm classically are often those that are very interesting for real world. Um Stefan, can you tell me about like how this sort of collaboration came about? Like how did you kind of you know work with Stephanie to realize this algorithm and what's kind of exciting about it? So a few years ago, I think 2023, we launched a uh quantum optimization working group. And this working group is um has been uh founded um by bringing together classical optimization experts, quantum algorithm experts, uh subject matter experts from different application domains like um energy, finance, logistics. And um the idea was to to to bring this diverse set of of expertise together to really discuss where can quantum computing help in optimization. And uh our goal was to approach this from different sides like more from the um complexity theory algorithm side from the um applications and benchmarking perspective and then also like if we have certain things how can we run this actually on hardware? How can we demonstrate things? In this working group, we meet uh once a year in person and have a like a deep dive brainstorming workshop where we where we come up with ideas and then uh discuss them in in in more depth to kick off new projects. And uh one question that um came up there is how how we can make use of a certain property that uh we expect quantum optimization algorithms have where they kind of differ from classical ones. And that property um Stefan hinted already at it is that we expect some of these quantum optimization algorithms to not only generate good solutions but diverse sets of good solutions. So they might not necessarily give you the best possible solution. Um they in in in certain cases classical algorithms might be better but they give you a diverse set of good solutions very very quickly. and this diversity. So we were wondering where can we make use of this property? Where can we make use of a algorithmic building block that generates um solutions that might be given the objective function we look at um equally good or of similar quality but that look completely differently if you then look at what decisions are actually being made. So if if we take that that finance example, you want to invest in certain assets to achieve a certain um uh expected return while uh not exceeding certain risk constraints. There might be plenty of different investments that achieve more or less the same result. uh you can invest in different industries and different companies and and and whatnot and there might be different things that that kind of from the objective perspective look the same but from what you actually do what the what are decisions you actually take are quite different and uh this is exactly what we are interested in in multi-objective optimization we want to learn what are the different um the different trade-offs and um so this is the the the perspective from from where we came and then in these discussions um multi-objective optimization was brought up as a possible uh application that could benefit from this and then we we took it from there. we had certain certain ideas how to possibly realize that and um then we came up with the algorithm that Stephanie um uh described and and uh tested this simulation then really on the on the on the quantum hardware and we could show that it um actually works works pretty well it could find um the full set of trade-offs for the problems we studied. So the full paro front um the ones the solutions that classical algorithms are better at finding but also the solutions that are uh more difficult to find for classical algorithms. And um that was that was pretty exciting to see that really quantum can work. And what we have found is actually that at the moment since we studied that at a at a um regime that we can still simulate classically that was with 42 cubits. We found that the classical simulation of our quantum algorithm was the best algorithm we we we had to solve the problem of interest. And that was pretty exciting because now um what this means is that or this gives a very strong indication that as we scale up this problem when the classical simulation breaks down the quantum computer is is then really the best or might turn out as the best way to solve this type of problem. And that was a very strong indication that was very very cool to see. And um uh that's kind of how this how this uh collaboration happened, why we looked into this, and then we um we wrote this paper about it. >> I want to harp on this for a second because this is something that we didn't really get to before, which is that like quantum I think when quantum was first emerging, people were like, I don't know if it's going to be that good for optimization. Like it could be. We'll see. Um and you know, people were asking questions like, is quantum going to solve the traveling salesman problem? And everybody was like, no, no, not at all. That's not how I maybe it'll make it faster, but it's not like we're going to exponentially speed up these already exponentially hard NP hard hardest problems. Um, but this is like exactly the kind of result that this is looking for, right? Like the fact that you find a quantum algorithm that the classical simulation of the quantum algorithm is the best solution or the best algorithm you have means that when we have a big quantum computer it's like a not guarantee but a very very strong you know very good promise that the quantum version when the quantum computer is big enough is going to be the best version if the classical version of the quantum version is the best version already. Um, and I think I I wanted I wanted to repeat that because it's actually very cool. Like this is we now have like pretty clear good feeling evidence that quantum might be the way to go for some of these really hard optimization problems like this multi-objective optimization problem which is extremely important clearly to anybody who's purchased a train ticket before. Right. >> [laughter] >> Um I I think you you mentioned a couple of very important points and uh to be able to demonstrate a quantum advantage, you first have to find a problem where there is a margin for a quantum advantage. And the uh famous traveling salesman problem usually is none of those. This is a problem even if it's uh in general NP hard and if it's very large often can be solved almost optimally with classical tools and um so it's not a good example for potential quantum advantage just because we can solve it so well classically to give you two examples um there's a so-called world tsp uh which is a tsp problem where the goal is to travel around almost 2 million cities like starting in one and then visiting every city and coming back to the original one in the in the with the shortest distance and um that can be solved almost optimally. So since that's tackled people now study the galaxy tsp which I think has about two billion stars. So that's that that's the kind of problems we we can solve if there's structure and this is what I mentioned earlier and what is very important here the TSP has a lot of structure and um usually if we look at the the TSP problems that arising from from real problems those um satisfy we say the triangular inequality meaning if you go from CDA to CDB directly that's always shorter or or at least never longer than going from A to B via C. Like if if you if you take another stop in the middle, you can't be faster than if you go directly. This is a a very strong structure that classical TSP solvers can leverage. If I give you a graph that doesn't satisfy that, then TSP can can uh become very difficult. But practically relevant problems usually have this kind of structure for tsp and uh so quantum I'm sure quantum will be able to solve tsp um at some point but classical too. So that's why it's not a good example for for a quantum advantage since classical is already so good at it. Stephanie, can we talk about the working group model and like how it actually helps you come up with new research and like push the field forward? >> Yeah, I think they like uh the main thing is this uh yearly in-person meeting for me at least. I think this very inspiring because everyone comes together not just for one uh hour talk but uh for today's and everyone is giving some ideas and we work to really work together on it like in workshops and in smaller groups and so on which is not always the case if something is called a workshop but there we really work together and I think it's so interesting when all those different people from different fields um give their ideas um yeah then you yourself get also more ideas Um and then can you tell me about like uh sort of how you got involved and uh what your sort of part what like the participation looks like and what you do after these sessions are over. Yeah, as I said, there are those yearly meetings, but then we also have um in smaller groups and we work on a specific project um bi-weekly meetings uh and there we just always keep up with the results and get and and share the task between us and everyone is then uh coming together and share what they had um developed in those two weeks. Uh yeah and this made a lot of progress. So now I want to talk about one of my favorite things that's come out of the uh the quantum optimization working group which is let's talk about the quantum advantage uh the quantum optimization decathlon which is um the uh this sort of effort to actually try and benchmark and find these quantum problems that are providing value for the world right that you know because so much as we sort of were saying earlier is about these huristics right it's hard with huristics to use it because it works that's how heristics work you know the best heruristic is usually the heristic that's working best for you. Um, but you actually get to have you need to have people trying all these problems out, these quantum heristic problems and all these other different problems to come up with what these best quantum algorithms are, right? Um, so that's I'm guessing what this quantum decathlon is. Maybe Stefan, you can start by telling me about the uh uh the quantum decathlon and why it's exciting. So from the very beginning of this optimization working group we had benchmarking as one of the important topics and as you said the uristics um are more like trial and error. Uh they they are often uh strongly motivated by by theory or based on experience or they are exact algorithms or approximations that are applied outside of the regime where the theory holds. So different ways to come up with uristics but then in the end you don't have any app prior guarantee you have to run them and see how well they works and that makes it very very um difficult to then say for your problem what's the best algorithm or the best uristic to to apply and it also makes it very difficult if I come with my quantum algorithm and I say um my quantum algorithm is best because I tested it and I tested two other uristics and uh then of course uh since the number of uristics is so large I cannot test all of them I don't even know all of them and then you can also fine-tune them and there are many things you can you can do and so um what we our goal was for this benchmarking effort um that we that we had in the working group to really come up with a set of problems that that like um a broad group of people agrees on are good candidates um publish them and then work with the community to test the different uristics such that um everybody can contribute results from their algorithm or the algorithms they're interested in and uh that that of course helps to to um have a robust baseline for any advantage claims. If this problem is public and the metrics are well defined and um uh everybody can test their algorithms against it and and share the results then if I come and I say hey my algorithm works best compared to all the ones that are in that benchmarking library then this is a very strong statement and that was the the the goal behind this quantum optimization benchmarking library. It's also called the interactable decaflon because we started with 10 problems and these 10 problems have been selected to be difficult classically. Um so there's some uh some some some reason that uh there's at least the margin for quantum advantage. We don't know whether there will be quantum advantage but at least they are believed to be difficult for classical ones. So there's room for improvement and um uh yeah these these problems are on a on a public repository. They're available as open source and we collect all the solutions that people uh contribute by by running their algorithms. And by all I mean um quantum and classical. So I said this is if you want to demonstrate quantum advantage or if you want to claim quantum advantage you need to make sure you are better than the classical alternatives and better can mean different things. It can mean faster. It can mean giving a better solution in terms of the objective value. It can mean cheaper. Um, and depending on your context, depending on what you want to achieve, you might put more or less emphasis on on some of these object or these these these metrics. Stephanie, how do you approach this sort of challenge like this when you see this list of problems and sort of these classical and quantum solutions like uh how do you actually go about this sort of act of creating algorithm of benchmarking and participating in this whole effort? Yeah, I think um that I would look the other way around not seeing the benchmark and seeing oh what can I do with this problem but basically when I have created for some problem an algorithm I really need such a benchmark to to test my my new algorithm on it and this saves actually a lot of workload if I already have a collection of problems that I should test and a collection from other people um algorithm MS their results um and the whole thing just speed ups research in general I guess. >> Is there problems that you're excited about? >> I am myself I'm mostly excited about multi-objective optimization which sadly is not part of the decapon but I but I think yes but maybe in the future it will be >> not yet >> not yet. [laughter] >> Yes. >> Well I feel like multi-objective optimization is like a privileged child here because we're like already know that it's going to be an exciting one. So why benchmark? We already did this classical quantum thing. It's already the best. >> Yeah, maybe like this. [snorts] >> So, I do want to just say that this is like to the listeners like this is a good summary actually of what's going on in quantum optimization is it's actually like really quickly advancing right now. There's like a lot of interest obviously because of the business interest. There's a lot of algorithms coming up. Like we have ideas of algorithms that might work but other algorithms might actually be the ones that we're most excited about. And so it's like uh the whole field is actually pressing forward in in so many different waves that it's actually like it's you know we're trying our best to keep track of certain things but other things are going to emerge kind of while it's all happening which I think is just makes it a very exciting time to be in the field right Stephanie. >> Yes. [laughter] >> I agree. >> Cool. Um, I like to slip in something silly usually towards the end, but I did want to say that this may be giving away where we are recording this, but the World Cup was recently and um, at the end of the Argentina Spain game, uh, Leandro uh, Pedes uh, grabbed the throat of of one of the Spanish players in an act of bad sportsmanship. Uh but uh all I could think about was not at all the game but in fact the I was just like parados paro front which we have been talking about before. Uh, and I'm not just saying that. It was literally like as I was watching the game, I thought it which is very silly. And I don't know if there's a use case for uh the multi-objective optimization in soccer, but I'm sure there'll be some value in it somewhere. >> Probably. As I said, multi-objective optimization is everywhere. >> And and you find sports tournament uh scheduling actually even as one of the problems in our benchmarking library. >> I'm so glad I brought it up. >> [laughter] >> Let's finish off with um one of my favorite questions uh which is just especially in a field like optimization. Um it's probably one of the most easily graspable and broadest applicable things when it comes to the real world, right? Um so maybe um we'll take one at a time. Stefan, what is one of the most exciting problems that you're excited to see quantum uh tackle in the field of >> in general? the fact that we can now since since few years already but now really increasing and that we can run these algorithms on real hardware and really try this at scale. This is very very exciting like like trying these new algorithms and and uh operating in a regime where you really cannot do that classically anymore where you need a quantum computer to make progress on this um development of huristics. This is um this is pretty pretty cool to me. And the concrete problem class um to me that to be honest doesn't matter too much because if you translate that to the math it's it's it's more like um what what kind of equations describe the constraints etc and how can we implement those on a quantum computer. Recently we found a way to decompose them with a fier transform. So we kind of decompose complex quantum circuits that represent um optimization problems that we usually cannot approach. We can decompose them using a fiery transform into a simpler set of circuits and uh then then run those on the real hardware and get get results for it. So by switching the representation we extend the the the reach of our hardware. So this is uh this is not linked to a concrete application but this is what I'm I'm thinking a lot about these days and what I'm quite excited about. I'm going to cut in here before I ask you Stephanie because this is something that we write about a lot now is that uh part of the running an algorithm is not just having a good algorithm but having a way to actually represent the data and I think some of the most important algorithms that we have basically we're not I mean the algorithm part was exciting but the exciting part was that somebody found a new way to take the data set and re-represent it so that it can be an existing algorithm to take advantage of it. uh hashing is like a really good example of this and like fastforier transform is a really good example of this like some of the most important algorithms we have. It was really all about finding a new way to represent the data. I wrote a blog about this once and uh maybe I'll put it in the comments if I can find it. Um and then uh Stephanie I'll then turn it over to you. What is what's really exciting right now for you? Yeah, I think uh I really want to dive more into um seeing what's special about quantum computers. that we already talked about earlier about this solution diversity and you maybe already know from our conser conversation that I'm have a passion for multi-objective optimization but they are like similar problem classes uh that have the same problems and structure uh for example robust optimization which is also very important for um real world problems. >> Thanks so much for joining me guys. This is really fun. Uh this is a topic that I feel like we will probably be continuing to talk about for the rest of time. So uh I wouldn't be surprised if uh one or both of you join us on the podcast again in the future. So thanks for your time for now, but I'll see you again. That's it for this episode of the Coherence Times. If you [clears throat] enjoyed our conversation, please be sure to subscribe wherever you get your podcasts or comment in the comment section and share it with somebody who's curious about quantum. You can find us on Spotify, Apple Podcasts, and YouTube via the IBM Research channel. And now for more deep dives, resources, and episodes, please visit us at ibm.com/thinkodcasts. I'm Ryan Mlebomb. Thanks for tuning in. And remember, the quantum future isn't just coming. We're building it right now. [music]