Appendix D: Survey results
10.1 The review undertook two surveys to identify views of the SSAs from a range of perspectives aligned to the focus of the review.
- A survey of Australian Government, State and Territory agencies, and Australian Universities who utilise the SSAs was undertaken as part of this review that received 98 responses.
- A survey of sellers to Australian Government and industry more broadly was published on the BuyICT website and received two industry submissions.
10.2 The section below provides a summary of the responses to the questions.
Note: each graphic provides detail on the number of responses received to the specific question in the top left-hand corner, or above the graph where there is multiple focus areas. Percentages in the graphs are based on the number of responses to the question.
Question: Which of the DTA’s SSAs has your agency used in the last 2-3 years?
10.3 For context, survey respondents are predominantly users of the Microsoft and AWS SSAs, with limited use of other SSAs in comparison, meaning that the answers to questions through the survey will be biased towards the use, benefit and challenges of those arrangements. However, due to similarities in the structure of the SSAs, the lessons learned through this survey were deemed to be applicable against each SSA, and useful in the context of future planning.
Question: Should whole of Australian Government Single Seller Arrangements exist for the technology sector?
10.4 Overwhelmingly respondents agreed that, yes, the SSAs should either exist in their current format and structure, or should exist, with need for some aspects to change. This is consistent with feedback obtained through stakeholder interviews. The reasons for the need for change are further captured in the following questions.
10.5 The opportunities to improve are summarised below:
- Need for Greater Flexibility: Respondents identified that improved flexibility in licensing arrangements would enable reduction in costs and improve usability. Respondents identified that the arrangements require flexibility to accommodate the varying sizes and needs of agencies, and the evolving nature of technology offerings (one size doesn’t fit all). Responses also suggested that, in absence of SSAs, smaller agencies are unable to access the benefits that larger agencies receive due to their relative spend.
- Improvement to Processes and Terms: Respondents identified the need for standardised terms and conditions and streamlining of processes across agreements to simplify agency onboarding and engagement. This includes consistent structures, centralised management of procurement risks, and uniform performance reporting to improve operation of the agreements.
- Improved Negotiation of Terms: Respondents identified the need to address issues like minimum commitments, pricing, and the ability to effectively adjust software or licensing arrangements during the agreement term. Further, respondents identified that refinement to negotiation timing and processes could potentially enhance decision making and enhance opportunities to achieve efficiencies. This could include more regular review of the arrangements.
- Enhanced Transparency and Reporting: Respondents identified the need for greater transparency and reporting against agreement terms and conditions, including improved performance reporting (including consideration of KPIs against delivery outcomes), metrics associated with benefits, and centralised repositories for contract related information. Respondents also identified a need for clear eligibility criteria for SSA participation.
- Centralised Management and Coordination: Respondents identified that there is an opportunity for the DTA to better coordinate information sharing, manage procurement risks (e.g. Foreign Ownership, Control and Influence (FOCI)), and oversee seller relationships. A respondent noted that it is challenging to keep pace with the changes in products offered by Sellers.
Improving the Strategic Partnership: Respondents identified the opportunity to strengthen the partnership with the sellers through balancing discounts against benefit or value provided through integrating objectives such as cyber security enhancement, increased collaboration between international and domestic suppliers, upskilling the workforce, addressing technology debt, and driving transformation in areas such as AI.
Further respondents identified strengthening the partnership model to seek greater investment in the country or the public sector through initiatives such as innovation funds, skills development, and research and development with universities and public sector should be considered.
- Support ecosystem diversity: Respondents identified that incentivising use of local SMEs, Indigenous suppliers, and service-based delivery partners within SSA frameworks should be considered, with consideration of how to limit the impact on procurement costs and regulation to SSA holders. This is further considered in the section of local participation.
- Consideration of a Tiered or Scaled Model: Respondents identified that consideration could be given to a tiered or scaled SSA model that allows smaller and newer suppliers to participate. Current panel arrangements such as DMP2 were deemed to align with this approach.
10.6 In response to why SSAs should not exist, a respondent noted consideration should be given to having a small number of vendors under each agreement, ideally tiered to agency size so that large resellers could assist large agencies and small resellers could assist small agencies (with less complex requirements). The review considered this and also deemed this to align with the intent of existing panel arrangements.
Question: In your experience, how effective are SSAs compared to other procurement methods (e.g. open tender, panel arrangements etc.)?
10.7 Respondents all identified that the SSAs are at least as good or better than other procurement methods. The section below provides a summary of both the positives and opportunities for improvement.
10.8 Respondents identified the following key themes noting that there are both positives, and opportunities for improvement against most aspects of the agreements.
- Cost Effectiveness: Responses highlight the financial benefits of the arrangements, including better pricing, volume discounts, and reduced individual agency expenses. Further, the consolidated bargaining power of the Commonwealth Government is recognised for enabling smaller agencies to access advantageous terms.
- Efficiency and Convenience: Feedback emphasises the streamlined processes and reduced administrative overheads. Responses highlight the ease of use, efficiency, effectiveness and time-saving aspects of the arrangements. A state government entity noted that the use of a specific Seller would not have been possible without the arrangement in place.
10.9 Responses identifying improvement opportunities:
- Complexity and Communication: Some responses point out the complexity of the arrangements, including difficult engagement processes, extensive documentation and challenges in understanding specific agreements and the offerings from the Sellers. Further, respondents identified that improvement to communication is required.
- Flexibility for Agency Requirements: Respondents noted that the SSAs often lack flexibility to meet specific agency requirements, necessitating additional negotiations. In some cases, the offerings do not align with agency needs as, when they are negotiated as a Whole of Australian Government approach, they fail to capture individual agency requirements. An example given identified that larger agency technology footprints and technology roadmaps are not accurately captured.
- Negotiation and Accessibility: Respondents identified that they have limited control or input to the negotiation process and that the timing and commitments can create challenges with regards to budget forecasting.
- Reporting Improvements: Respondents noted that information captured on AusTender relating to Open Tender approaches to the market relating to mandatory use of SSAs incorrectly identify the procurement as Limited Tender.
Question: Have SSAs adapted or evolved to accommodate changes in the following areas: Regulation and legislation, Organisational policy, and Developments in technology
10.10 The survey responses indicate that there is a generally positive sentiment towards whether the SSAs have adapted or evolved to accommodate changes in regulation, legislation and organisation policy, and developments in technology. Respondents identified that the SSAs do have some flexibility, but require further improvement to respond to regulatory, market and technological shifts in a more responsive manner.
10.11 Responses identifying improvement opportunities:
- Speed to change: Some responses identified that the mechanisms intended to allow adaptation to new and emerging technologies are often slow, administratively complex, and inconsistently applied. Overall, their ability to keep pace with fast-evolving technology and regulatory settings is currently limited. More flexible, modular agreements that adapt quickly to technology and regulatory changes were identified as a potential improvement opportunity.
Question: Monetary benefits of SSAs. Which of these monetary benefits has your agency received from SSAs? (Select all that apply)
10.12 The survey identified the majority of monetary benefits stem discounts, along with price stability and predictability, which correlates with responses from interviews with stakeholders. The data also shows that half of respondents benefit from lower procurement overheads and reduced contract management costs.
10.13 The response highlights that the special offers and incentives offered under the arrangements are considered less of a benefit, which correlates with interview feedback indicating a need for further transparency and education on these benefits and how to access them.
Question: Non-Monetary benefits of SSAs. Which of these non-monetary benefits has your agency received from SSAs? (Select all that apply):
10.14 Respondents identified that the pre-negotiated terms and conditions and simplified / streamlined procurement are the major non-monetary benefits of the SSAs, with half indicating that improved contract compliance and risk management was a benefit.
10.15 Other non-monetary benefits identified include the opportunity to engage with and share experiences and challenges faced by other buyers in working with the sellers with an SSA, along with reduced reliance on legal advice as contract terms and conditions have been agreed. This enables increased focus on value for money negotiation instead of focus on risk-assessing contract clauses.
Question: Thinking about the wider technology ecosystem and supply chain, how much do you agree that SSAs contribute to supporting the following: Australian Businesses, Indigenous Businesses, Women led Businesses, and Small to Medium Enterprise?
10.16 Analysis of the responses indicates that there is slightly negative sentiment towards whether the SSAs contribute to the participation from the businesses such as Australian, Indigenous, Women led or Small to Medium Enterprises, indicating that the arrangements do not foster engagement of these sectors in their current form.
10.17 Respondents noted the opportunity for the strategic nature of the SSAs to be leveraged to drive a stronger strategic partnership with the sellers, leading to greater investment in the Australian market and public sector, aligned to national priorities. This could include incentivising the use of suppliers such as Indigenous or women-led businesses.
10.18 Responses also identified opportunities including the use of local services and subcontracting under the SSAs, strategic partnerships with Indigenous businesses, skills development initiatives and support to innovation hubs as an opportunity for SSA sellers to contribute to fostering Australian economic participation.
10.19 Further analysis is provided in the Alignment to policy, strategies and legislation section of this report.
Question: What key activities or strategies can help drive Australian business participation in the SSA supply chain?
10.20 Respondents indicate that stronger application of the government policy position such as Indigenous Procurement Policy could drive greater participation in the supply chain, including consideration from the sellers in establishing strategic partnerships with Indigenous businesses. Further respondents identified that there is the potential to ensure broader economic benefit through defining minimum targets for local participation through the SSAs.
10.21 Respondents also provided examples of opportunities to drive participation through access to skills building initiatives across diverse communities and further engagement in initiatives that drive and promote local innovation, research and development and emerging technologies.
Question: Have you experienced any unexpected or unintended consequences from using SSAs? If yes, please specify and suggest any mitigation strategies.
10.22 Responses to the free text question regarding the unintended consequences of the SSA arrangements are summarised below:
- Cost Implications: Responses identified unexpected cost implications due to the timing of the SSA negotiations, and minimum commitments resulting in cost inefficiencies, and changes in arrangements that resulted in the inability to reduce license commitments. Further respondents identified a need for clarity on fees and recovery charges with the DTA. Some of these challenges were identified as being offset by the SSA providing the ability for procurement and contract management teams to invest time in high value procurement activities.
- Financial and License Entitlement Clarity: Respondents identified the need for greater clarity and visibility around applicable CAF or CRF savings fees to enable greater understanding of procurement costs. This extends to improved tracking and understanding of changes to license entitlements under renegotiated arrangements.
- Currency of Technology Offering: Respondents identified that without review, offerings under the SSA may include legacy products that are no longer fit-for-purpose and conversely may not accurately reflect new offerings and services. The responses also identified the need for consideration of SSAs for other market segments / products.
- Negotiation Challenges: Respondents identified their ability to influence and contribute to SSA negotiations is limited and includes minimal interaction, resulting in an inability to negotiate agency specific requirements and loss lesser ability to realise efficiencies. Further, respondents noted that the timing of the negotiations can have unintended consequences to agencies from a cost perspective.
- Education Requirements: Respondents identified that there can be misunderstanding of procurement rules with agencies assuming that the SSAs overrule competitive procurement requirements, and a perception of a buyer being locked into a seller. Further, respondents sought clarity on whether the SSAs are a procurement “green light” or “red carpet” for vendors who have an SSA.
- Communication and Understanding Issues: Responses identified a need for increased understanding of the rationale behind decisions relating to the way in which SSAs were designed and implemented, and a need for enhanced communication and clarity to improve understanding of decision making in the negotiation process, including improved collaboration.
Question: In your experience, are there models you are aware of from sourcing arrangements in other nations or Australian States and Territories we should consider?
10.23 Responses provided references to models such as the NSW Government, United States and United Kingdom sourcing models, which have been considered as a part of this review, with specific reference in Appendix F: International comparisons.
Question: Is there anything else you'd like to raise that has not been covered in this survey?
10.24 Four key thematics were identified:
- Improved pricing transparency: Responses encourage broader sharing of pricing books and ongoing support costs for the SSAs to support internal decision making and requirements definition.
- Future planning: Responses encouraged the DTA to consider further SSAs for large software companies to streamline the purchasing process through agreed terms and conditions.
- Survey response results: Responses identified that the outcomes from surveys of agencies using the SSAs, including proposed actions should be provided as an update from the DTA.
- Earlier renegotiations: Responses indicate that the timing of negotiations can leave government agencies with limited time to consider their internal position on the arrangements before the establishment of the head agreement.