Evaluating the Q-score of Quantum Annealers

W. van der Schoot; D. Leermakers; R. Wezeman; N. Neumann; F. Phillipson

doi:10.1109/QSW55613.2022.00017

Evaluating the Q-score of Quantum Annealers

W. van der Schoot^*, D. Leermakers, R. Wezeman, N. Neumann, F. Phillipson

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceeding › Academic › peer-review

Abstract

We report the Atos Q-score for D-Wave's quantum devices, classical algorithms and hybrid quantum-classical solver. Computing the Q-score entails solving the Max-Cut problem for increasingly large graphs. This work presents the first computation of the Q-score on a quantum device and shows how these quantum devices compare to classical devices at solving optimisation problems. We use D-Wave's standard methods out of the box with a time limit of 60 seconds. The Q-score for D-Wave's 2000Q and Advantage devices are 70 and 140, respectively. The Q-score for two of D-Wave's classical algorithms, based on tabu search and simulated annealing respectively, are 2,300 and 5,800. Finally, we report the out-of-the-box hybrid approach to have a Q-score of 12,500.

Original language	English
Title of host publication	Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022
Editors	Shaukat Ali, Claudio Agostino Ardagna, Johanna Barzen, Hongyi Bian, Carl K. Chang, Rong N. Chang, Ernesto Damiani, Ismael Faro, Sebastian Feld, Frank Leymann, Francisco Jose Martin-Fernandez, Robert Ward, Manuel Wimmer, Fatos Xhafa, Jessie Yu, Jia Zhang
Publisher	IEEE
Pages	9-16
Number of pages	8
ISBN (Electronic)	9781665481342
ISBN (Print)	978-1-6654-8135-9
DOIs	https://doi.org/10.1109/QSW55613.2022.00017
Publication status	Published - 2022
Event	1st IEEE International Conference On Quantum Software (IEEE QSW) / IEEE World Congress on Services (IEEE SERVICES) - Barcelona, Spain Duration: 11 Jul 2022 → 15 Jul 2022 https://conferences.computer.org/qsw/2022/

Conference

Conference	1st IEEE International Conference On Quantum Software (IEEE QSW) / IEEE World Congress on Services (IEEE SERVICES)
Country/Territory	Spain
City	Barcelona
Period	11/07/22 → 15/07/22
Internet address	https://conferences.computer.org/qsw/2022/

Keywords

Quantum computing
application-oriented benchmarks
quantum annealing
Q-score
D-Wave
Max-Cut
MAX-CUT
Max-Cut.

Access to Document

10.1109/QSW55613.2022.00017

Cite this

van der Schoot, W., Leermakers, D., Wezeman, R., Neumann, N., & Phillipson, F. (2022). Evaluating the Q-score of Quantum Annealers. In S. Ali, C. A. Ardagna, J. Barzen, H. Bian, C. K. Chang, R. N. Chang, E. Damiani, I. Faro, S. Feld, F. Leymann, F. J. Martin-Fernandez, R. Ward, M. Wimmer, F. Xhafa, J. Yu, & J. Zhang (Eds.), Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022 (pp. 9-16). IEEE. https://doi.org/10.1109/QSW55613.2022.00017

van der Schoot, W. ; Leermakers, D. ; Wezeman, R. et al. / Evaluating the Q-score of Quantum Annealers. Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022. editor / Shaukat Ali ; Claudio Agostino Ardagna ; Johanna Barzen ; Hongyi Bian ; Carl K. Chang ; Rong N. Chang ; Ernesto Damiani ; Ismael Faro ; Sebastian Feld ; Frank Leymann ; Francisco Jose Martin-Fernandez ; Robert Ward ; Manuel Wimmer ; Fatos Xhafa ; Jessie Yu ; Jia Zhang. IEEE, 2022. pp. 9-16

@inproceedings{181cea707862485b88a1bbcba76bbc47,

title = "Evaluating the Q-score of Quantum Annealers",

abstract = "We report the Atos Q-score for D-Wave's quantum devices, classical algorithms and hybrid quantum-classical solver. Computing the Q-score entails solving the Max-Cut problem for increasingly large graphs. This work presents the first computation of the Q-score on a quantum device and shows how these quantum devices compare to classical devices at solving optimisation problems. We use D-Wave's standard methods out of the box with a time limit of 60 seconds. The Q-score for D-Wave's 2000Q and Advantage devices are 70 and 140, respectively. The Q-score for two of D-Wave's classical algorithms, based on tabu search and simulated annealing respectively, are 2,300 and 5,800. Finally, we report the out-of-the-box hybrid approach to have a Q-score of 12,500.",

keywords = "Quantum computing, application-oriented benchmarks, quantum annealing, Q-score, D-Wave, Max-Cut, MAX-CUT, Max-Cut.",

author = "{van der Schoot}, W. and D. Leermakers and R. Wezeman and N. Neumann and F. Phillipson",

note = "data source: no data used Publisher Copyright: {\textcopyright} 2022 IEEE.; 1st IEEE International Conference On Quantum Software (IEEE QSW) / IEEE World Congress on Services (IEEE SERVICES) ; Conference date: 11-07-2022 Through 15-07-2022",

year = "2022",

doi = "10.1109/QSW55613.2022.00017",

language = "English",

isbn = "978-1-6654-8135-9",

pages = "9--16",

editor = "Shaukat Ali and Ardagna, {Claudio Agostino} and Johanna Barzen and Hongyi Bian and Chang, {Carl K.} and Chang, {Rong N.} and Ernesto Damiani and Ismael Faro and Sebastian Feld and Frank Leymann and Martin-Fernandez, {Francisco Jose} and Robert Ward and Manuel Wimmer and Fatos Xhafa and Jessie Yu and Jia Zhang",

booktitle = "Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022",

publisher = "IEEE",

address = "United States",

url = "https://conferences.computer.org/qsw/2022/",

}

van der Schoot, W, Leermakers, D, Wezeman, R, Neumann, N & Phillipson, F 2022, Evaluating the Q-score of Quantum Annealers. in S Ali, CA Ardagna, J Barzen, H Bian, CK Chang, RN Chang, E Damiani, I Faro, S Feld, F Leymann, FJ Martin-Fernandez, R Ward, M Wimmer, F Xhafa, J Yu & J Zhang (eds), Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022. IEEE, pp. 9-16, 1st IEEE International Conference On Quantum Software (IEEE QSW) / IEEE World Congress on Services (IEEE SERVICES), Barcelona, Spain, 11/07/22. https://doi.org/10.1109/QSW55613.2022.00017

Evaluating the Q-score of Quantum Annealers. / van der Schoot, W.; Leermakers, D.; Wezeman, R. et al.
Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022. ed. / Shaukat Ali; Claudio Agostino Ardagna; Johanna Barzen; Hongyi Bian; Carl K. Chang; Rong N. Chang; Ernesto Damiani; Ismael Faro; Sebastian Feld; Frank Leymann; Francisco Jose Martin-Fernandez; Robert Ward; Manuel Wimmer; Fatos Xhafa; Jessie Yu; Jia Zhang. IEEE, 2022. p. 9-16.

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceeding › Academic › peer-review

TY - GEN

T1 - Evaluating the Q-score of Quantum Annealers

AU - van der Schoot, W.

AU - Leermakers, D.

AU - Wezeman, R.

AU - Neumann, N.

AU - Phillipson, F.

PY - 2022

Y1 - 2022

N2 - We report the Atos Q-score for D-Wave's quantum devices, classical algorithms and hybrid quantum-classical solver. Computing the Q-score entails solving the Max-Cut problem for increasingly large graphs. This work presents the first computation of the Q-score on a quantum device and shows how these quantum devices compare to classical devices at solving optimisation problems. We use D-Wave's standard methods out of the box with a time limit of 60 seconds. The Q-score for D-Wave's 2000Q and Advantage devices are 70 and 140, respectively. The Q-score for two of D-Wave's classical algorithms, based on tabu search and simulated annealing respectively, are 2,300 and 5,800. Finally, we report the out-of-the-box hybrid approach to have a Q-score of 12,500.

AB - We report the Atos Q-score for D-Wave's quantum devices, classical algorithms and hybrid quantum-classical solver. Computing the Q-score entails solving the Max-Cut problem for increasingly large graphs. This work presents the first computation of the Q-score on a quantum device and shows how these quantum devices compare to classical devices at solving optimisation problems. We use D-Wave's standard methods out of the box with a time limit of 60 seconds. The Q-score for D-Wave's 2000Q and Advantage devices are 70 and 140, respectively. The Q-score for two of D-Wave's classical algorithms, based on tabu search and simulated annealing respectively, are 2,300 and 5,800. Finally, we report the out-of-the-box hybrid approach to have a Q-score of 12,500.

KW - Quantum computing

KW - application-oriented benchmarks

KW - quantum annealing

KW - Q-score

KW - D-Wave

KW - Max-Cut

KW - MAX-CUT

KW - Max-Cut.

U2 - 10.1109/QSW55613.2022.00017

DO - 10.1109/QSW55613.2022.00017

M3 - Conference article in proceeding

SN - 978-1-6654-8135-9

SP - 9

EP - 16

BT - Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022

A2 - Ali, Shaukat

A2 - Ardagna, Claudio Agostino

A2 - Barzen, Johanna

A2 - Bian, Hongyi

A2 - Chang, Carl K.

A2 - Chang, Rong N.

A2 - Damiani, Ernesto

A2 - Faro, Ismael

A2 - Feld, Sebastian

A2 - Leymann, Frank

A2 - Martin-Fernandez, Francisco Jose

A2 - Ward, Robert

A2 - Wimmer, Manuel

A2 - Xhafa, Fatos

A2 - Yu, Jessie

A2 - Zhang, Jia

PB - IEEE

T2 - 1st IEEE International Conference On Quantum Software (IEEE QSW) / IEEE World Congress on Services (IEEE SERVICES)

Y2 - 11 July 2022 through 15 July 2022

ER -

van der Schoot W, Leermakers D, Wezeman R, Neumann N, Phillipson F. Evaluating the Q-score of Quantum Annealers. In Ali S, Ardagna CA, Barzen J, Bian H, Chang CK, Chang RN, Damiani E, Faro I, Feld S, Leymann F, Martin-Fernandez FJ, Ward R, Wimmer M, Xhafa F, Yu J, Zhang J, editors, Proceedings - 2022 IEEE International Conference on Quantum Software, QSW 2022. IEEE. 2022. p. 9-16 doi: 10.1109/QSW55613.2022.00017