supermarq.qcvv.base_experiment

Base experiment class and tools used across all experiments.

Attributes

ResultsT

Classes

QCVVExperiment

Base class for gate benchmarking experiments.

QCVVResults

A dataclass for storing the data and analyze results of the experiment. Requires

Sample

A sample circuit to use along with any data about the circuit

Functions

qcvv_resolver(→ type[Any] | None)

Resolves string's referencing classes in the QCVV library. Used by cirq.read_json()

Module Contents

class supermarq.qcvv.base_experiment.QCVVExperiment(qubits: int | collections.abc.Sequence[cirq.Qid], num_circuits: int, cycle_depths: collections.abc.Iterable[int], *, random_seed: int | numpy.random.Generator | None = None, results_cls: type[ResultsT], _samples: collections.abc.Sequence[Sample] | None = None, **kwargs: Any)

Bases: abc.ABC, Generic[ResultsT]

Base class for gate benchmarking experiments.

The interface for implementing these experiments is as follows:

  1. First instantiate the desired experiment object

    experiment = ExampleExperiment(<<args/kwargs>>)
    
  2. Prepare the circuits and run the experiment on the desired target. This can either be a custom simulator or a real device name. For example:

    noise_model = cirq.depolarize(p=0.01, n_qubits=1)
    sim = cirq.DensityMatrixSimulator(noise=noise_model)
    
    results = experiment.run_with_simulator(simulator=sim, <<args/kwargs>>)
    
  3. Then we analyse the results. If the target was a local simulator this will be available as soon as the run_with_simulator() method has finished executing. On the other hand if a real device was accessed via Superstaq then it may take time for the data to be available from the server. The results.data_ready attribute will return True when all data has been collected and is ready to be analyzed.

    if results.data_ready():
        results.analyze(<<args>>)
    

When implementing a new experiment, 4 methods need to be implemented:

  1. experiment._build_circuits(): Given a number of circuits and an iterable of the

    different numbers of layers to use, return a list of Sample objects that need to be sampled during the experiment.

  2. results._analyse_results(): Analyse the experimental data and store the final

    results, for example some fidelities.

  3. results.plot_results(): Produce any relevant plots that are useful for understanding

    the results of the experiment.

  4. results.print_results(): Prints the results to the console.

static canonicalize_bitstring(key: int | str, num_qubits: int) str

Checks that the provided key represents a bit string for the given number of qubits. If the key is provided as an integer then this is reformatted as a bitstring.

Parameters:
  • key – The integer or string which represents a bitstring.

  • num_qubits – The number of bits that the bitstring needs to have

Raises:
  • ValueError – If the key is integer and negative

  • ValueError – If the key is integer but to large for the given number of qubits.

  • ValueError – If the key is a string but the wrong length.

  • ValueError – If the key is a string but contains characters that are not 0 or 1.

  • TypeError – If the key value is not a string or integral.

Returns:

The canonicalized representation of the bitstring.

static canonicalize_probabilities(results: collections.abc.Mapping[str, float] | collections.abc.Mapping[int, float], num_qubits: int) dict[str, float]

Reformats a dictionary of probabilities/counts so that all keys are bitstrings and that there are no missing values. Also renormalizes so that the resulting probabilities sum to 1 and sorts the dictionary by bitstring.

Parameters:
  • results – The unformatted probabilities or counts

  • num_qubits – The number of qubits, used to determine the bitstring length.

Raises:
  • ValueError – If any counts or probabilities are negative.

  • ValueError – If there are no non-zero counts.

Returns:

The formatted dictionary of probabilities.

classmethod from_file(filename: str | pathlib.Path) typing_extensions.Self

Load the experiment from a json file.

Parameters:

filename – Filename to load from.

Returns:

The loaded experiment.

results_from_records(records: _typeshed.SupportsItems[uuid.UUID | int, collections.abc.Mapping[str, float] | collections.abc.Mapping[int, float]]) ResultsT

Creates a results object from records of the counts/probabilities for each sample circuit. This function is aimed at users who would like to use the QCVV framework to generate sample circuits and analyse the results but need to run these circuits without submitting a job to Superstaq.

Parameters:

records – A dictionary of the counts/probabilities for each sample, keyed by either the sample UUID or the index of the sample in the experiment. The counts/probabilities for each sample should be provided as a dictionary of keyed by either the bitstring or the integer value of that bitstring.

Returns:

The experiment results object.

run_on_device(target: str, repetitions: int = 10000, method: str | None = None, **target_options: Any) ResultsT

Submit the circuit samples to the desired target device and store the resulting probabilities.

The set of circuits is partitioned as necessary to not exceed the maximum circuits that can be submitted to the given target device. The function then waits for the jobs to complete before saving the resulting probability distributions.

Parameters:
  • target – The name of a Superstaq target.

  • repetitions – The number of shots to sample. Defaults to 10,000.

  • method – Optional method to use on the Superstaq device. Defaults to None corresponding to normal running.

  • target_options – Optional configuration dictionary passed when submitting the job.

Returns:

The experiment results object.

run_with_callable(circuit_eval_func: collections.abc.Callable[[cirq.Circuit], collections.abc.Mapping[str, float] | collections.abc.Mapping[int, float]], **kwargs: Any) ResultsT

Evaluates the probabilities for each circuit using a user provided callable function. This function should take a circuit as input and return a dictionary of probabilities for each bitstring (including states with zero probability).

Parameters:
  • circuit_eval_func – The custom function to use when evaluating circuit probabilities.

  • kwargs – Additional arguments to pass to the custom function.

Returns:

The experiment results object.

run_with_simulator(simulator: cirq.Sampler | None = None, repetitions: int = 10000) ResultsT

Use the local simulator to sample the circuits and store the resulting probabilities.

Parameters:
  • simulator – A local Sampler to use. If None then the default cirq.Simulator simulator is used. Defaults to None.

  • repetitions – The number of shots to sample. Defaults to 10,000.

Returns:

The experiment results object.

to_file(filename: str | pathlib.Path) None

Save the experiment to a json file.

Parameters:

filename – Filename to save to.

property circuits: list[cirq.Circuit]

All circuits in this experiment, as a list.

cycle_depths

The different cycle depths to test at.

num_circuits

The number of circuits to build for each cycle depth.

property num_qubits: int

The number of qubits used in the experiment.

qubits: tuple[cirq.Qid, Ellipsis]
class supermarq.qcvv.base_experiment.QCVVResults

Bases: abc.ABC

A dataclass for storing the data and analyze results of the experiment. Requires subclassing for each new experiment type.

analyze(plot_results: bool = True, print_results: bool = True, plot_filename: str | None = None) None

Perform the experiment analysis and store the results in the results attribute.

Parameters:
  • plot_results – Whether to generate plots of the results. Defaults to True.

  • print_results – Whether to print the final results. Defaults to True.

  • plot_filename – Optional argument providing a filename to save the plots to. Ignored if plot_results=False Defaults to None, indicating not to save the plot.

abstract plot_results(filename: str | None = None) matplotlib.pyplot.Figure

Plot the results of the experiment.

Parameters:

filename – Optional argument providing a filename to save the plots to. Defaults to None, indicating not to save the plot.

Returns:

A single matplotlib figure containing the relevant plots of the results data.

abstract print_results() None

Prints the key results data.

data: pandas.DataFrame | None = None

The raw data generated.

property data_ready: bool

Whether the experimental data is ready to analyse.

Raises:

RuntimeError – If their is no stored data and no Superstaq job to use to collect the results.

experiment: QCVVExperiment[QCVVResults]

Reference to the underlying experiment that generated these results experiment.

job: cirq_superstaq.Job | None = None

The associated Superstaq job (if applicable).

property num_circuits: int

Returns: The number of circuits in the experiment.

property num_qubits: int

Returns: The number of qubits in the experiment.

property parent: typing_extensions.Self
property qubits: tuple[cirq.Qid, Ellipsis]
property samples: collections.abc.Sequence[Sample]

Returns: The number of samples used.

target: str

The target device that was used.

class supermarq.qcvv.base_experiment.Sample

A sample circuit to use along with any data about the circuit that is needed for analysis.

circuit: cirq.Circuit

The raw (i.e. pre-compiled) sample circuit.

circuit_realization: int

Indicates which realization of the random circuit this sample is. There will be D samples with matching circuit realization value, one for each cycle depth being measured. This index is useful for grouping results during analysis.

data: dict[str, Any]

The corresponding data about the circuit that is needed when analyzing results (e.g. cycle depth).

uuid: Sample.uuid

The unique ID of the sample.

supermarq.qcvv.base_experiment.qcvv_resolver(cirq_type: str) type[Any] | None

Resolves string’s referencing classes in the QCVV library. Used by cirq.read_json() to deserialize.

Parameters:

cirq_type – The type being resolved

Returns:

The corresponding type object (if found) else None

Raises:

ValueError – If the provided type is not resolvable

supermarq.qcvv.base_experiment.ResultsT