Skip to content

Commit

Permalink
Updated index.qmd with Who is this guidance for section aligned with …
Browse files Browse the repository at this point in the history
…branch 11-sample-table
  • Loading branch information
zarbspace committed Feb 21, 2024
1 parent b0118e5 commit 0ae8b37
Show file tree
Hide file tree
Showing 4 changed files with 57 additions and 25 deletions.
2 changes: 1 addition & 1 deletion .quarto/preview/lock
Original file line number Diff line number Diff line change
@@ -1 +1 @@
5004
18140
30 changes: 18 additions & 12 deletions docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -4717,9 +4717,10 @@
<h2 id="toc-title">On this page</h2>

<ul>
<li><a href="#aims" id="toc-aims" class="nav-link active" data-scroll-target="#aims">Aims</a></li>
<li><a href="#who-is-this-guidance-for" id="toc-who-is-this-guidance-for" class="nav-link active" data-scroll-target="#who-is-this-guidance-for">Who is this guidance for?</a></li>
<li><a href="#aims" id="toc-aims" class="nav-link" data-scroll-target="#aims">Aims</a></li>
<li><a href="#how-the-questions-draw-on-other-frameworks" id="toc-how-the-questions-draw-on-other-frameworks" class="nav-link" data-scroll-target="#how-the-questions-draw-on-other-frameworks">How the questions draw on other frameworks</a></li>
<li><a href="#structure-of-the-guidance" id="toc-structure-of-the-guidance" class="nav-link" data-scroll-target="#structure-of-the-guidance">Structure of the guidance</a>
<li><a href="#structure-of-the-quality-questions" id="toc-structure-of-the-quality-questions" class="nav-link" data-scroll-target="#structure-of-the-quality-questions">Structure of the quality questions</a>
<ul class="collapse">
<li><a href="#a-quality-questions-and-why-they-matter" id="toc-a-quality-questions-and-why-they-matter" class="nav-link" data-scroll-target="#a-quality-questions-and-why-they-matter">a) Quality Questions and why they matter</a></li>
<li><a href="#b-the-questions-and-the-code-of-practice-for-statistics" id="toc-b-the-questions-and-the-code-of-practice-for-statistics" class="nav-link" data-scroll-target="#b-the-questions-and-the-code-of-practice-for-statistics">b) The questions and the Code of Practice for Statistics</a></li>
Expand Down Expand Up @@ -4767,9 +4768,14 @@ <h1 class="title">Quality Questions Introduction</h1>
</div>
</div>
</div>
<section id="who-is-this-guidance-for" class="level2">
<h2 class="anchored" data-anchor-id="who-is-this-guidance-for">Who is this guidance for?</h2>
<p>This guidance provides a set of questions to help analytical and statistical teams evaluate the quality of their analysis throughout the production cycle.</p>
<p>The guidance is here to support teams in meeting the Office for National Statistics’s (ONS) strategic objectives for improving statistical quality. You can find more information about our strategic objectives on statistical quality in the <a href="https://www.ons.gov.uk/methodology/methodologytopicsandstatisticalconcepts/qualityinofficialstatistics/onsstatisticalqualityimprovementstrategy">ONS Statistical Quality Improvement Strategy</a>. ONS manages quality through a <a href="https://officenationalstatistics.sharepoint.com/sites/onswiki/SitePages/ONS_quality_management.aspx?csf=1&amp;web=1&amp;e=xyAJcG&amp;cid=3da18120-8bb7-4e1f-ad34-e2793e555231">strategic risk approach</a>.</p>
<p>We have made the guidance available on Github in case others wish to use the Quality Questions resource in their own work.</p>
</section>
<section id="aims" class="level2">
<h2 class="anchored" data-anchor-id="aims">Aims</h2>
<p>This guidance provides a set of questions to help analytical and statistical teams evaluate the quality of their analysis throughout the production cycle. The guidance is here to support teams in meeting the Office for National Statistics’s (ONS) strategic objectives for improving statistical quality. You can find more information about our strategic objectives on statistical quality in the <a href="https://www.ons.gov.uk/methodology/methodologytopicsandstatisticalconcepts/qualityinofficialstatistics/onsstatisticalqualityimprovementstrategy">ONS Statistical Quality Improvement Strategy</a>. ONS manages quality through a <a href="https://officenationalstatistics.sharepoint.com/sites/onswiki/SitePages/ONS_quality_management.aspx?csf=1&amp;web=1&amp;e=xyAJcG&amp;cid=3da18120-8bb7-4e1f-ad34-e2793e555231">strategic risk approach</a>.</p>
<p>The guidance has five main aims:</p>
<ol type="1">
<li>To help analysts understand the level of risk they are carrying in their analytical workflows.</li>
Expand All @@ -4779,13 +4785,13 @@ <h2 class="anchored" data-anchor-id="aims">Aims</h2>
</li>
<li>To ensure there is a consistent understanding of roles and responsibilities when producing high quality analysis and statistics.<br>
</li>
<li>To make it easier to create critical project documentation including an <a href="https://officenationalstatistics.sharepoint.com/:x:/r/sites/anstanpi/Modelling_Best_Practice/Resources/quality_assurance_templates/assumptions_and_decision_log_template.xlsx?d=wdfc9cdc643584edca8317e49aff8e67b&amp;csf=1&amp;web=1&amp;e=4MSSwy">assumptions and decisions log</a>, issue and decisions log, risk register and divisional <a href="https://officenationalstatistics.sharepoint.com/sites/onswiki/SitePages/Managing_Quality_Mechanisms.aspx">Quality Improvement Plan</a>.</li>
<li>To make it easier to create critical project documentation including an <a href="assumptions_and_decision_log_template.xlsx">assumptions and decisions log</a>, issue and decisions log, risk register and divisional <a href="https://officenationalstatistics.sharepoint.com/sites/onswiki/SitePages/Managing_Quality_Mechanisms.aspx">Quality Improvement Plan</a>.</li>
</ol>
<p>Reflecting on the questions asked in the template will help you to manage your analysis risks:</p>
<ol type="1">
<li>You will be able to document the mitigation that is in place or planned.<br>
</li>
<li>You will know that the project is prepared to accept issues or risks and why this is.<br>
<li>You will know which issues and risks the project is prepared to accept and why.<br>
</li>
<li>You can identify potential quality issues and decide how to manage and prioritise them.<br>
</li>
Expand All @@ -4794,16 +4800,16 @@ <h2 class="anchored" data-anchor-id="aims">Aims</h2>
</section>
<section id="how-the-questions-draw-on-other-frameworks" class="level2">
<h2 class="anchored" data-anchor-id="how-the-questions-draw-on-other-frameworks">How the questions draw on other frameworks</h2>
<p>The <a href="https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government">AQuA book</a> sets out a standard framework for managing analytical quality in government. The AQuA framework is there to make sure that our work can be trusted to inform good decision making, while the <a href="https://code.statisticsauthority.gov.uk/">Code of Practice for Statistics</a> sets out the principles and practices that producers of official statistics should commit to.</p>
<p>The <a href="https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government">AQuA book</a> sets out a standard framework for managing analytical quality in HM Government. AQuA is there to make sure that our work can be trusted to inform good decision making, while the <a href="https://code.statisticsauthority.gov.uk/">Code of Practice for Statistics</a> sets out the principles and practices that producers of official statistics should commit to.</p>
<p>Two other pieces of guidance have motivated us to produce this template. One is the <a href="https://analysisfunction.civilservice.gov.uk/policy-store/quality-questions-and-red-flags/#:~:text=The%20%27Quality%20Questions%20and%20Red,for%20National%20Statistics%20">Analysis Function guidance on Quality Questions and Red Flags</a>. The other is the Office for Statistics Regulation (OSR) guidance on <a href="https://osr.statisticsauthority.gov.uk/publication/regulatory-guidance-thinking-about-quality-when-producing-statistics/">Thinking about quality when producing statistics</a>. Both of these provide sets of questions that analysts can use to interrogate their work and assure its quality.</p>
<p>Building on these cross-government resources, this guidance sets out quality questions that are relevant for each stage of analytical cycle. The quality questions are at their most effective if they are asked at the right stage. Once that stage is passed, experience suggests that it is normally difficult to go back and address the points the questions ask by retrofitting at a later stage of the analysis.</p>
<p>Building on these resources, this guidance sets out quality questions that are relevant for each stage of analytical cycle. The quality questions are at their most effective if they are asked at the right stage. Once that stage is passed, experience suggests that it is normally difficult to go back and address the points the questions ask by retrofitting at a later stage of the analysis.</p>
<p>Each question is linked with the Code of Practice for Statistics pillars of <a href="https://code.statisticsauthority.gov.uk/the-code/trustworthiness/">Trustworthiness</a>, <a href="https://code.statisticsauthority.gov.uk/the-code/quality/">Quality</a> and <a href="https://code.statisticsauthority.gov.uk/the-code/value/">Value</a>. We explain the importance and relevance of each question in light of the three pillars so teams can better understand and apply these principles through out the project life cycle.</p>
<p>Quality questions are also categorised by which responsible role from the AQuA book would usually answer them. The idea is to highlight the clear line of accountability set out in the AQuA book in an easy-to-understand manner. We want to make it easier for teams to decide how the three key assurance roles of commissioner, senior responsible owner (and their analysis team) and analytical assurer are covered in their own workflows.</p>
<p>Quality questions are also linked to which responsible role from the <a href="https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government">AQuA book</a> would usually answer them. The idea is to highlight the clear line of accountability set out in the AQuA book in an easy-to-understand manner. We want to make it easier for teams to decide how the three key assurance roles of commissioner, senior responsible owner (and their analysis team) and analytical assurer are covered in their own workflows.</p>
</section>
<section id="structure-of-the-guidance" class="level2">
<h2 class="anchored" data-anchor-id="structure-of-the-guidance">Structure of the guidance</h2>
<section id="structure-of-the-quality-questions" class="level2">
<h2 class="anchored" data-anchor-id="structure-of-the-quality-questions">Structure of the quality questions</h2>
<p>There are 61 quality questions in total. They cover all the stages of the analytical cycle.</p>
<p>Answering 61 questions probably seems like a daunting task at first! The questions are designed to help you as you work your way through the analytical process, rather than to be answered all at once. Creating a log of answers as you move through the stages of the analysis workflow will help you to check that your work meets analytical standards, follows good practice and (if relevant) complies with the Code of Practice for Statistics.</p>
<p>Answering 61 questions probably seems quite daunting at first! The questions are designed to help you as you work your way through the analytical process, rather than to be answered all at once. Creating a log of answers as you move through the stages of the analysis workflow will help you to check that your work meets analytical standards, follows good practice and (if relevant) complies with the Code of Practice for Statistics.</p>
<p>Answering the questions will also help you make sure that everybody working on the analysis has a clear understanding of how and why it works as it does, and to support your users when writing your outputs. Moreover, most of the answers will help you to produce the critical documents that mitigate risk like an assumptions log, decisions log, issues log, and technical guides for your team and your users.</p>
<p>The AQuA book divides the analytical cycle into four stages:</p>
<ol type="1">
Expand Down Expand Up @@ -4841,7 +4847,7 @@ <h3 class="anchored" data-anchor-id="c-linking-the-questions-to-aqua-roles">c) L
</li>
<li>Analytical assurer</li>
</ul>
<p>Let’s look at the roles in more detail.</p>
<p>Let’s look at the roles more detail.</p>
<p><strong>Responsibilities of the Commissioner</strong><br>
The commissioner is focused on making sure the analysis meets the required user needs.<br>
* Ensures that context around the work is understood so quality assurance is appropriate and proportionate.<br>
Expand Down
Loading

0 comments on commit 0ae8b37

Please sign in to comment.