July 10, 2014
5 min

User research and agile squadification at Trade Me

Optimal Workshop

Hi, I’m Martin. I work as a UX researcher at Trade Me having left Optimal Experience (Optimal Workshop's sister company) last year. For those of you who don’t know, Trade Me is New Zealand’s largest online auction site that also lists real estate to buy and rent, cars to buy, jobs listings, travel accommodation and quite a few other things besides. Over three quarters of the population are members and about three quarters of the Internet traffic for New Zealand sites goes to the sites we run.

Leaving a medium-sized consultancy and joining Trade Me has been a big change in many ways, but in others not so much, as I hadn’t expected to find myself operating in a small team of in-house consultants. The approach the team is taking is proving to be pretty effective, so I thought I’d share some of the details of the way we work with the readers of Optimal Workshop’s blog. Let me explain what I mean…

What agile at Trade Me looks like

Over the last year or so, Trade Me has moved all of its development teams over to Agile following a model pioneered by Spotify. All of the software engineering parts of the business have been ‘squadified’. These people produce the websites & apps or provide and support the infrastructure that makes everything possible.Across Squads, there are common job roles in ‘Chapters’ (like designers or testers) and because people are not easy to force into boxes, and why should they be, there are interest groups called ‘Guilds’.The squads are self-organizing, running their own processes and procedures to get to where they need to. In practice, this means they use as many or as few of the Kanban, Scrum, and Rapid tools they find useful. Over time, we’ve seen that squads tend to follow similar practices as they learn from each other.

How our UX team fits in

Our UX team of three sits outside the squads, but we work with them and with the product owners across the business.How does this work? It might seem counter-intuitive to have UX outside of the tightly-integrated, highly-focused squads, sometimes working with product owners working on stuff that might have little to do with what’s being currently developed in the squads. This comes down to the way Trade Me divides down the UX responsibilities within the organization. Within each squad there is a designer. He or she is responsible for how that feature or app looks, and, more importantly, how it acts — interaction design as well as visual design.Then what do we do, if we are the UX team?

We represent the voice of Trade Me’s users

By conducting research with Trade Me’s users we can validate the squads’ day-to-day decisions, and help frame decisions on future plans. We do this by wearing two hats. Wearing the pointy hats of structured, detailed researchers, we look into long-term trends: the detailed behaviours and goals of our different audiences. We’ve conducted lots of one-on-one interviews with hundreds of people, including top sellers, motor parts buyers, and job seekers, as well as running surveys, focus groups and user testing sessions of future-looking prototypes. For example, we recently spent time with a number of buyers and sellers, seeking to understand their motivations and getting under their skin to find out how they perceive Trade Me.

This kind of research enables Trade Me to anticipate and respond to changes in user perception and satisfaction.Swapping hats to an agile beanie (and stretching the metaphor to breaking point), we react to the medium-term, short-term and very short-term needs of the squads testing their ideas, near-finished work and finished work with users, as well as sometimes simply answering questions and providing opinion, based upon our research. Sometimes this means that we can be testing something in the afternoon having only heard we are needed in the morning. This might sound impossible to accommodate, but the pace of change at Trade Me is such that stuff is getting deployed pretty much every day, many of which affects our users directly. It’s our job to ensure that we support our colleagues to do the very best we can for our users.

How our ‘drop everything’ approach works in practice

Screen Shot 2014-07-11 at 10.00.21 am

We recently conducted five or six rounds (no one can quite remember, we did it so quickly) of testing of our new iPhone application (pictured above) — sometimes testing more than one version at a time. The development team would receive our feedback face-to-face, make changes and we’d be testing the next version of the app the same or the next day. It’s only by doing this that we can ensure that Trade Me members will see positive changes happening daily rather than monthly.

How we prioritize what needs to get done

To help us try to decide what we should be doing at any one time we have some simple rules to prioritise:

  • Core product over other business elements
  • Finish something over start something new
  • Committed work over non-committed work
  • Strategic priorities over non-strategic priorities
  • Responsive support over less time-critical work
  • Where our input is crucial over where our input is a bonus

Applying these rules to any situation makes the decision whether to jump in and help pretty easy.At any one time, each of us in the UX team will have one or more long-term projects, some medium-term projects, and either some short-term projects or the capacity for some short-term projects (usually achieved by putting aside a long-term project for a moment).

We manage our time and projects on Trello, where we can see at a glance what’s happening this and next week, and what we’ve caught sniff of in the wind that might be coming up, or definitely is coming up.On the whole, both we and the squads favour fast response, bulleted list, email ‘reports’ for any short-term requests for user testing.  We get a report out within four hours of testing (usually well within that). After all, the squads are working in short sprints, and our involvement is often at the sharp end where delays are not welcome. Most people aren’t going to read past the management summary anyway, so why not just write that, unless you have to?

How we share our knowledge with the organization

Even though we mainly keep our reporting brief, we want the knowledge we’ve gained from working with each squad or on each product to be available to everyone. So we maintain a wiki that contains summaries of what we did for each piece of work, why we did it and what we found. Detailed reports, if there are any, are attached. We also send all reports out to staff who’ve subscribed to the UX interest email group.

Finally, we send out a monthly email, which looks across a bunch of research we’ve conducted, both short and long-term, and draws conclusions from which our colleagues can learn. All of these latter activities contribute to one of our key objectives: making Trade Me an even more user-centred organization than it is.I’ve been with Trade Me for about six months and we’re constantly refining our UX practices, but so far it seems to be working very well.Right, I’d better go – I’ve just been told I’m user testing something pretty big tomorrow and I need to write a test script!

Publishing date
July 10, 2014
Share this article

Related articles

min read
Create a user research plan with these steps

A great user experience (UX) is one of the largest drivers of growth and revenue through user satisfaction. However, when budgets get tight, or there is a squeeze on timelines, user research is one of the first things to go. Often at the cost of user satisfaction.  

This short sighted view can mean project managers are preoccupied with achieving milestones and short term goals. And UX teams get stuck researching products they weren’t actually involved with developing. As a result no one has the space and understanding to really develop a product that speaks to users needs, desires and wants. There must  be a better way to produce a product that is user-driven.  Thankfully there is.

What is user research and why should project managers care about it? 👨🏻💻

User research is an important part of the product development process. Primarily, user research involves using different research methods to gather information about your end users. 

Essentially it aims to create the best possible experience for your users by listening and learning directly from those that already or potentially will use your product. You might conduct interviews to help you understand a particular problem, carry out a tree test to identify bottlenecks or problems in your navigation, or do some usability testing to directly observe your users as they perform different tasks on your website or in your app. Or a combination of these to understand what users really want.

To a project manager and team, this likely sounds fairly familiar, that any project can’t be managed in a silo. Regular check-ins and feedback are essential to making smart decisions. The same with UX research. It can make the whole process quicker and more efficient. By taking a step back, digging into your users’ minds, and gaining a fuller understanding of what they want upfront, it can curtail short-term views and decisions.

Bringing more user research into your development process has major benefits for the team, and the ultimately the quality of that final product. There are three key benefits:

  1. Saves your development team time and effort. Ensuring the team is working on what users want, not wasting time on features that don’t measure up.
  2. Gives your users a better experience by meeting their requirements.
  3. Helps your team innovate quickly by understanding what users really want.

As a project manager, making space and planning for user research can be one of the best ways to ensure the team is creating a product that truly is user-driven.

How to bring research into your product development process 🤔

There are a couple of ways you can bring UX research into your product development process

  1. Start with a dedicated research project.
  2. Integrate UX research throughout the development project.

It can be more difficult to integrate UX research throughout the process, as it means planning the project with various stages of research built in to check the development of features. But ultimately this approach is likely to turn out the best product. One that has been considered, checked and well thought out through the whole product development process. To help you on the way we have laid out 6 key steps to help you integrate UX research into your product development process.

6 key steps to integrate UX research 👟

Step 1: Define your research questions

Take a step back, look at your product and define your research questions

It may be tempting just to ask, ‘do users like our latest release?’ This however does not get to why or what your users like or don’t like. Try instead:

  • What do our users really want from our product?
  • Where are they currently struggling while using our website?
  • How can we design a better product for our users?

These questions help to form the basis of specific questions about your product and specific areas of research to explore which in turn help shape the type of research you undertake.

Step 2: Create your research plan

With a few key research questions to focus on, it’s time to create your research plan.

A great research plan covers your project’s goals, scope, timing, and deliverables. It’s essential for keeping yourself organized but also for getting key stakeholder signoff.

Step 3: Prepare any research logistics

Every project plan requires attention to detail including a user research project. And with any good project there are a set of steps to help make sense of it.

  1. Method: Based on your questions, what is the best user research method to use? 
  2. Schedule: When will the research take place? How long will it go on for? If this is ongoing research, plan how it will be implemented and how often.
  3. Location: Where will the research take place? 
  4. Resources: What resources do you need? This could be technical support or team members.
  5. Participants: Define who you want to research. Who is eligible to take part in this research? How will you find the right people?
  6. Data: How will you capture the research data? Where will it be stored? How will you analyze the data and create insights and reports that can be used?
  7. Deliverables: What is the ultimate goal for your research project?

Step 4: Decide which method will be used

Many user research methods benefit from an observational style of testing. Particularly if you are looking into why users undertake a specific task or struggle.

Typically, there are two approaches to testing:

  1. Moderated testing is when a moderator is present during the test to answer questions, guide the participant, or dig deeper with further questions.
  2. Unmoderated testing is when a participant is left on their own to carry out the task. Often this is done remotely and with very specific instructions.Your key questions will determine which method will works best for your research.  Find our more about the differences.

Step 5: Run your research session

It’s time to gather insights and data. The questions you are asking will influence how you run your research sessions and the methods you’ve chosen. 

If you are running surveys you will be asking users through a banner or invitation to fill out your survey. Unmoderated and very specific questions. Gathering qualitative data and analyzing patterns.

If you’re using something qualitative like interviews or heat mapping, you’ll want to implement software and gather as much information as possible.

Step 6: Prepare a research findings report and share with stakeholders

Analyze your findings, interrogate your data and find those insights that dive into the way your users think. How do they love your product? But how do they also struggle?

Pull together your findings and insights into an easy to understand report. And get socializing. Bring your key stakeholders together and share your findings. Bringing everyone across the findings together can bring everyone on the journey. And for the development process can mean decisions can be user-driven. 

Wrap Up 🥙

Part of any project, UX research should be essential to developing a product that is user-driven. Integrating user research into your development process can be challenging. But with planning and strategy it can be hugely beneficial to saving time and money in the long run. 

min read
Effective user research: Your north star

The Age of the Customer is well and truly here. In every industry and vertical across the globe, UX professionals now dictate the terms, placing customers at the heart of every design decision. Or at least, this is the new reality that’s unfolding in the organizations and businesses that don’t want to be left behind.

Make no mistake; simply claiming to be the best is no longer enough. To survive and thrive, people need to be placed at the heart. The golden key that will allow organizations to pivot to this new reality lies with that of the user researcher.

But it’s not enough to simply “do user research”. Sure, some customer insight is obviously better than none at all, but to really be useful it needs to be effective research. That’s what this article is all about.

Get comfortable, because this is going to be a long one – for good reason.

Why (effective) user research is so important

You are not your user. As much as you may like to think that you are, you’re not. It can be a tricky proposition to get your head around, especially when we regularly assume that everyone thinks like us. There are 8 billion people out there who have a vastly different set of experiences and perspectives than you. With that in mind, when we start to generalize based on our own personal experiences, this is what’s known as availability bias.

Unfortunately, solving this is issue not as easy as getting into a room with customers and having a chat. People don’t always tell the truth! This isn’t to say that the participant in your last user interview was flat out lying to you, but the things that people say are different from the things that people do. It;’s your job (as a user researcher) to intuit the actual behaviors and actions, and identify their needs based on this data.

When you’re doing your job correctly, you’ve given your organization the best possible chance of success. Everything  – and I mean everything – starts with a solid understanding of your users. Doors will open, paths will reveal themselves – you get the idea.

The qualities of an effective user researcher

Let me preface this section by saying that you don’t have to have all of these qualities in spades, the list below is really just a way for you to better understand some of the traits of an effective user researcher, to get you thinking and on the right path.

  • Curious: User research can be quite repetitive, especially when you get to the 6th user interview and need to ask the same questions. A genuine curiosity about people, the challenges they face and their behaviors will go a long way in helping you to push through.
  • Pragmatic: Being an idealist has its uses, but it’s also important to be pragmatic. As a researcher, you need to operate on a fine line and balance your capacity to do research with business goals, finances and the desires of your stakeholders. Do the most with what you’ve got.
  • Organized: It takes a lot to plan a research project, from scheduling testing sessions to assembling large slide decks for presentations. You’ve got to manage a large number of complex components, so it’s important that you can organize and prioritize.
  • Collaborative: User research is most effective when it’s carried out collaboratively. This means working with your team, with the organization and with other disciplines. Think outside the box: Who stands to benefit from your research and how can you involve them?
  • Empathetic: Real, natural empathy is a rare trait, but adopting an empathetic mindset is something everyone can (and should) learn. Beyond just uncovering insights from your participants, consider what these insights mean and how they all connect. This will truly enable you to understand your users.
  • Sociable: You don’t have to suddenly adopt an extroverted persona, but being actively interested in other people will help you build relationships both inside your organization and with customers.
  • Perceptive: User research means listening and observing. During a user interview or usability test, you need to be able to filter all of the data entering your mind and extract the most relevant insights.
  • Analytical: In a similar vein to perceptiveness, being analytical is also key if you want to understand all of the data that your research will produce. Filter, examine, extract and move on.

How to run user research effectively (and at a low cost)

There are innumerable methods for user research, but many are resource- and time-intensive. What’s more, certain research methods come attached with significant costs.

But, research doesn’t have to be the time and money sink that it can often first appear to be. Certain actions before you ever step into the room with a participant can make a world of difference.

Conduct research at the start

User research is obviously valuable whenever you do it, but you’ll see the biggest impact when you carry it out right the start of a project. Conduct research to get the lay of the land; to learn how and why customers make certain decisions, and where the biggest opportunities lie.

Note: Don’t research in a silo, involve your team, stakeholders and other interested parties.

Have clear goals – and a plan

Every research project needs a clear objective, and that comes from a detailed UX research plan, which includes well-formulated research questions. Every project will have a different question, but they’re the best starting point to ensure research success.

Choose the right methods

There’s no shortage of research methods to choose from, but being an effective user researcher is all about being able to pick the right methods for each project, and use them correctly. Nearly every research project will benefit from using a combination of qualitative and quantitative methods in order to generate the most useful insights.

To understand which method to use, it’s a good idea to view them using the following framework:

Source: Nielsen Norman Group
A landscape of user research methods

Involve stakeholders

Bring stakeholders into your research project as early as possible. These are the people that will end up utilizing the results of your work, and chances are they’re the ones who’ll have the most questions at the end. Involve them through consultation, regular updates, the all-too-important presentation at the end of the project and by letting them take notes for you during research sessions.

Wrap up

It’s not enough to simply run a card sort now (although that’s still a very useful exercise). You need to think cohesively about the role of your research in your organization and make sure that you’re as aware of your bias as you are of the various methods and tools available to you. Happy researching!

min read
How to quickly and easily run user research

We all know that robust user research is key when it comes to creating human-centred, intuitive products that deliver outstanding user experiences.

But we also know that many of us (especially those in marketing and design) are guilty of not doing research as often as we should – or even not at all. Often, it’s considered expensive and time consuming. However, with the right user research tools, research can start almost immediately, and we can analyze data in days, not weeks).

All of this to say, you can work with insights that are up to date and can help you inform strong product design at any stage of the product life cycle.

Why is UX research important? 🤳 🎯

Right up front, it’s worth stating that you are not your user

With all the will in the world your product (or website or mobile app) may work perfectly and be as intuitive as possible. But, if it is only built on information from your internal organizational perspective and applied with all of your knowledge and experience, it may not measure up in the eye of your user. Often, organizations make major design decisions without fully considering their users. User research backs up decisions with data, helping to make sure that design decisions are smart decisions. 

User experience (UX) research focuses your design on understanding your user expectations, behaviors, needs and motivations. This is done through methodical and investigative approaches. Through data analysis, insights can be used to ensure that all product design decisions benefit the user. It’s all about helping you to gain insights and knowledge that may not be as apparent from the inside. 

User research is an essential part of creating, building and maintaining great products. Providing invaluable insights that inform from the ground up. Helping to structure the information architecture and the underlying performance of your product.

User research throughout design, development and further into the lifecycle of your product will mean less uncertainty and risk. All good things when creating a product that ultimately is intended to generate conversions. UX is at the heart of all we design and create. User research is crucial to creating human-centred design. Creating and developing digital solutions that answer users' needs.

Building better products means a better user experience and ultimately higher retention and conversion rates.  What’s better than a single user experience? A customer that comes back again and again. 

This can sound like a lot of work, but with the right type of user research it can take days, not weeks, to draw out useful and actionable insights.

Getting started with user research needn’t be expensive, time consuming or only done at the start of a project. Let’s look at when research may be of most benefit. If you need a little help selling user research to your broader stakeholders, check out our article. 

Discover navigation issues on your website 📍🗺️ 😡

One type of research that should be done regularly is testing how users navigate your website. Navigation issues on your website can lead to missed opportunities and lower conversion rates. 

Using a tree testing tool like Treejack, at any point in your website lifecycle, allows you to work ‘backwards’ and gain a clearer understanding of where users are getting lost, or uncertain of the next step. Invaluable insights into how your website is working currently and where updates and repairs or reorganising can lead to an overall better product and UX.

This type of research can be done at any point and can be particularly useful to identify how users interact with your homepage. Over 80% of users will know within seconds if they will stay on your website, they need to be easily guided to complete tasks. Don’t lose them at the first look.

Build a new and effective mobile app 📲 🎉

A mobile app answers something that a website can’t or can’t do as efficiently. This could be booking hair appointments, updating membership loyalty points, or checking the weather.

By downloading an app a user wants quick, simple and easy interaction and access to information. While all of this information may be available on your website it may not be as readily found or easily personalized. In some cases, with personalized information (membership numbers or credit card details) this can not be held safely on websites or easily stored and accessed.

User research through first-click testing with a tool like Chalkmark can inform the usability of the mobile app interface. First-click testing on mobile apps allows you to rapidly test ideas and ensure your design supports user goals before you invest time and money in further design work and development.

Continued user research throughout the life of the app and making updates that improve the interaction will mean a long term life of your app.

Learn how people use your product 💎 👀

Undertaking usability testing at any stage can benchmark how your product is currently being used. Providing insights into how it can be improved, reordered or information sorted better. 

Here are a few key user research tools that can be picked up and used quickly and with a small investment, meaning they can be done regularly.

  • Card sorting is a great tool for investigating how users intuitively sort information. Find out how they would like to see information sorted that would make the experience easier and more intuitively. You can get started with OptimalSort now and have data and insights back in days, not weeks.
  • Tree testing is an investigative tool which follows where users go when they arrive at your website. Highlighting where they get lost and where they get stuck. All valuable information when relying on responsiveness and conversion. Getting started with Treejack is simple and quick, allowing data driven results to inform decisions for a new or existing website.
  • First-click testing looks at where users go first. Where do they click on your website or your mobile app? This information will highlight how users view the interface and what they are drawn to first. Allowing your design to be influenced by intuitive behaviour and ultimately driving usability. Chalkmark is a tool which you can quickly and easily get started with, allowing your product to be intuitive from the start, or enhanced with data driven insights.

Build better products 🧱

Learning how your product usability, backed with data and insights means that product design can be more intuitive, human-centred and ensure a more positive end user experience. Working with data driven insights also helps stakeholders to understand why design may be challenged, updated or changed.

All of this needn’t be at the high cost of time, energy and delay. These tools are all readily available and can be implemented in days, not weeks. They are easy to use, and data can be easily digested and transformed into real changes.

Seeing is believing

Dive into our platform, explore our tools, and discover how easy it can be to conduct effective UX research.