Posts

Why Should Your Industry or Trade Association Hire an Outside Consultant for Member Surveys?

An independent research consultant helps trade and industry associations get higher response rates, candid member feedback, and credible data the board, management, and staff can act on – by combining guaranteed confidentiality, multimode outreach (phone, email, text, and mail), and the impartiality of a third party who understands association governance.


Important

  • Confidentiality unlocks honesty. Members are far more likely to share real opinions about leadership, dues value, and organizational direction when a neutral third party – not association management – collects the data.
  • Multimode outreach captures the full membership. Most associations blast an email link and call it research. A consultant can reach members how they prefer to communicate – by phone, email, text, and mail, pulling in voices that a single channel misses.
  • Third-party credibility protects the findings. When results come from an impartial firm, they are far less likely to be dismissed – especially on divisive issues like dues increases, policy positions, or leadership performance.
  • Representative data strengthens the association’s voice. Associations exist to speak for an industry, profession, or trade. A methodologically sound survey ensures that voice actually reflects the membership.

Industry and trades

Why Do Most Board- and Management-led Association Surveys Underperform?

Management doesn’t have the same tools as professional researchers, nor can they credibly promise confidentiality. This means low response rates, largely from the most engaged members. The data ends up reflecting a narrow, self-selected slice of the membership – not the broad base the association represents.


How Does Confidentiality Change What Members Are Willing to Say?

Whether it’s fear of embarrassment, or retribution, or something else, members often avoid honest answers on sensitive topics. An outside consultant creates a clear separation between individual responses and association leadership.

The firewall matters on questions that matter most: satisfaction with management/staff performance, perceived value of dues, effectiveness of advocacy efforts, and values alignment.


Why Does Multimode Outreach Matter for Associations?

We all have different communication preferences. Email. Text message. Phone calls. Mail. Choose only one mode and you will limit your responses. Choose more than one or all of them and your participation rate increases dramatically.

Layering these modes closes the gap between engaged insiders and the broader, quieter membership. That distinction matters — boards and staff already know what the engaged members think. The value of a survey is hearing from everyone else.


What Makes a Third-Party Consultant More Credible?

Impartiality removes the most common objection to survey findings: that board leadership or management shaped the questions or the results to support a predetermined conclusion.

You value having a consultant who has direct experience in association governance – understanding board structures, committee dynamics, member segmentation, and the political realities of running a membership organization. That experience produces smarter questionnaire design, analysis, and findings presented in terms the board and management can immediately act on.

All survey results should be assumed to be confidential (for internal use only) unless there is an overt decision otherwise. If there is intention to use data externally, for advocacy / regulatory comments / public testimony (“80% of our membership opposes the new legislation”), or media (“We want to partner with local community colleges to help train the next generation of our trade. An internal survey of our members found near unanimous support for diversifying our workforce.”). Policymakers and journalists scrutinize methodology. Data collected by an independent research firm withstands that scrutiny.


When Should a Trade Association Bring In an Outside Consultant?

When the board or management needs member input they can defend – internally or externally. Common scenarios include:

ScenarioWhy Outside Research Helps
Annual member satisfaction surveysEstablishes a credible benchmark the board can track year over year
Dues increase or restructuringDemonstrates actual member willingness to pay before the board votes
Strategic planningCaptures priorities from the full membership, not just committees
Legislative and regulatory advocacyProduces defensible data for testimony, public comment, and media
Merger or partnership discussionsGauges member sentiment before committing the organization
Event and programming evaluationIdentifies what members actually value versus what staff assumptions

FAQ

Can’t our association manager just run the survey internally?
Yes, they can. And managers have operational knowledge that is invaluable in designing a survey, but whether real or just assumed, they have a stake in the outcome. Members know this. An independent consultant removes that perceived conflict, which is what makes the difference between data the board debates and data the board acts on.

Is this cost-effective for a smaller or regional association?
Maybe. If you are struggling to pay the rent or phone bill, then hiring a professional research firm is not a good idea. The cost often depends on factors like size (number of members) and length of survey (number of questions). You should budget single-digit thousands to tens of thousands.

How long does a professionally managed association survey take?
Most projects run six to eight weeks from questionnaire design through final reporting. The field period – when members are being contacted across all modes – typically lasts three to four weeks.

Probolsky Research is a market and opinion research firm with association, corporate, election, government, and nonprofit clients.

Published in GreenBook: Four Ways to Make Inclusive Research Lead to More Accurate Insights

Adam Probolsky was recently featured in GreenBook with an original article about how to make insights more accurate (and inclusive).

Key Takeaways:

  • Ensure people with disabilities can participate.
  • Incorporate multiple language options.
  • Choose research modes that reach your audience.
  • Grow & train a research team with inclusivity in mind.

Read the full article here: https://www.greenbook.org/insights/research-methodologies/four-ways-to-make-inclusive-research-lead-to-more-accurate-insights

Amazon vs. Temu: E-Commerce Giants Face Off

We decided to go deep with a unique subset of U.S. consumers: Those who have made a purchase from both Amazon and Temu in the last year. Full results available here for download and also shown below.

Price Wars: Temu Wins

  • 76% of respondents consider Temu cheaper than Amazon
  • Temu’s competitive pricing is a major draw for budget-conscious shoppers

Amazon’s Speed Advantage

  • 81% say Amazon’s shipping is much faster
  • Amazon’s efficient logistics and last-mile capabilities are hard to beat

Product Variety: It’s Close

  • 45% find similar variety on both platforms
  • Amazon edges with a somewhat greater selection

Return Policies and Customer Service

  • 50% prefer Amazon’s return policies
  • 50% rate Amazon’s customer service as better; 45% rate them as similar

The Review Factor

  • 58% value reviews equally on both platforms
  • 32% consider reviews more important on Amazon

Overall Consumer Behavior

Both giants have their strengths. Temu wins on price, while Amazon excels in shipping speed and product variety.


The survey of 340 U.S. consumers who shopped on both platforms provides a unique view of consumer behavior and the e-commerce landscape. Check out our infographic for all the details.

The online panel-driven survey was conducted from 6/21/2024 to 6/24/2024 with a margin of error of +/-5.6%.

Probolsky Research is a woman and Latina-owned market and opinion research firm. We did not have a client associated with this research. It was conducted for public interest only.

PRessing on in Public Relations Podcast – Guest Appearance by Adam Probolsky

Adam Probolsky went deep on the opinion/market research – public relations/outreach nexus during the latest episode of PRessing on in Public Relations Podcast with Liselle DeGrave and Rachel McGuire.

Listen here: https://www.pressingonpodcast.com/podcast/episode/2bacf575/data-data-data-benchmarking-for-strategic-success

Quantitative and Qualitative Research in the Branding Process

Originally published at CivicBrand https://www.civicbrand.com/insights/articles/quantitative-and-qualitative-research-in-the-branding-process

Destination branding is often ineffective without a robust research phase during the branding process. Public sentiment research, competitive research and other types of research are the foundations of the brand strategy and help narrow in on the story that the brand is to tell. Especially as budgets have tightened in response to Covid-19 and other factors, research plays an even more critical role in the process. Research and data help districts, cities, counties and DMOs feel comfortable with and confident in the direction of the brand and its campaigns. Research is what makes branding feel like money well spent.

Both quantitative and qualitative research are important to the branding process. We sometimes see cities place more of an emphasis on the quantitative side, but the reality is that both types of research have value and need to play a role in branding. The balance of each type will be different from project to project, but we believe both should always be employed.

The role of quantitative research

Quantitative research is helpful because it provides hard numbers to reference and compare. We sometimes partner with Probolsky Research, a market research firm based in California, to help us design and implement quantitative research strategies, as we trust their expertise in this area. By conducting statistically valid, multi-modal surveys, we can confidently identify trends, measure sentiments and behaviors, and understand the perception of a destination brand based on data from a representative sample of the place’s population (or a regional population if doing competitive or key market research).

The key benefit of quantitative research is confidence. If done correctly, your data will be representative of the population you survey, and you’ll have better data based on demographic groups (including by geography), so you can be confident in the insights derived from the data. That means public leaders and the public at large will have more confidence in the branding process. You’ll also reach a large number of people fairly easily and can establish benchmarks (like brand awareness in key markets, net promoter scores, etc.) that you can compare year-over-year to ensure the effectiveness of advertising campaigns.

An example of Probolsky Research’s benchmarking work with the City of Napa, California

Quantitative research is also particularly useful when done through an “external” lens — that is, to gauge how outside markets view your destination as a place to visit, move or start a business. You can quickly design a survey that runs in a few key markets, and within a relatively short amount of time, you’ll have a good sense of the way many different regions view your place.

The role of qualitative research

Qualitative research, on the other hand, is much more nuanced. It “summarizes and infers, rather than pin-points an exact truth.” If the role of quantitative research during the branding process is to provide you with the hard numbers you need to back up your decisions, qualitative research illuminates the story of your brand and the people it represents. Focus groups, man-on-the-street style interviews, and casual conversations and observations, while somewhat anecdotal, can help you get a better sense of the feel of the brand, narrow in on the stories of different demographics, and add richness and depth to quantitative data.

QUALITATIVE RESEARCH ILLUMINATES THE STORY OF YOUR BRAND AND THE PEOPLE IT REPRESENTS.BRISA BYFORD – SENIOR STRATEGIST, CIVICBRAND

For example, in our work in Waupaca, Wisconsin, the brand strategy can be summarized by Chain + Main, where Chain is shorthand for all of the outdoor recreation activities the area has to offer, and Main is shorthand for vibrant community activities, restaurants, businesses and more. Connecting the two areas together is critical for economic development in the area, but that strategy would have been hard to hone in on with just a survey.

The same can be said for our work in Heartland Lakes, Minnesota. The challenge of that project involved uniting several different small communities and marketing them as part of a larger area. The previous name for the area was a mouthful and didn’t resonate with a lot of people. Only through our qualitative research, when we were literally standing on the Heartland Trail that physically connects the area’s communities, did we realize the place should be called Heartland Lakes. It was a lightbulb moment that wouldn’t have had the same effect in survey data.

Heartland Lakes focus group

There is extreme value in how much qualitative research connects to public engagement. Your efforts to engage with the public and talk to them about the project have a direct effect on community buy-in and the project’s outcome. If the branding process is done behind closed doors, it’s a lot easier for people to dissent or distract from the message. However if your qualitative research extends a hand to the public and invites them into the process, you’ll create brand champions that will not only provide you with critical feedback, but rally people (and money) around the brand. In this way, qualitative research can have more of an “internal” lens.

The role of equity in research

Think of these types of research as a Venn diagram, with quantitative on the left on qualitative on the right. In the middle, where the two circles overlap, lies the concept of equity, which is something we talk a lot about at CivicBrand. We pride ourselves on having an equitable approach to research and public engagement. That means we make an extra effort to reach the demographics that are traditionally underserved or hard to reach. With quantitative research specifically, we oversample in order to get a clearer picture of the perceptions and attitudes of certain demographics (foreign language speakers, for example). With qualitative research, we identify different groups that may be hard to reach and then go directly to them. At that point it’s no longer a random sample, but hearing their stories is necessary to telling the bigger, brand story.

The role of both types

If quantitative research is the analytical left brain, qualitative research is the creative right brain. By combining both methods, you get the most accurate read of human behavior. But if you lean too far to one side, you miss out on the value of the other method. Stories collected in qualitative research should always be validated as being relatable to the broader audience by testing them in a survey.

STORIES COLLECTED IN QUALITATIVE RESEARCH SHOULD ALWAYS BE VALIDATED…BY TESTING THEM IN A SURVEY. ADAM PROBOLSKY – PRESIDENT, PROBOLSKY RESEARCH

It’s also important that you don’t forget your audience. Research should be engaging, regardless of type. Any data you collect should be usable and actionable, and it should guide the brand strategy but not rule it.

At the end of the day, if something produces clarity and insight, regardless of the type of research, it’s valuable. We believe it’s better to focus on the insight itself (and what you can do with the brand because of it) than the way it was discovered.

Listen to CivicBrand CEO Ryan Short, CivicBrand Senior Strategist Brisa Byford, and Probolsky Research President Adam Probolsky discuss this topic in more detail on the CivicBrand podcast.

To learn more about CivicBrand, check out their work.

Water Agency Messaging Webinar

Today we conducted our first water agency messaging webinar of 2021. Alfonso Ordaz, one of our research analysts, and Desiree Probolsky our CEO, kicked off the 30-minute session and Adam Probolsky provided the key insights and answered participant questions.

These are not your typical messages. It’s worth watching and reaching out for a private briefing.

We are operating at full capacity – most staff working remotely

Probolsky Research continues to conduct important market and opinion research projects as our clients and the world deal with the impacts of COVID-19.

You can reach us at any of our office phone numbers, by email, or on our mobile phones, anytime.

Most of our staff is working from home which is easy for us considering nearly all our work is by phone or online using our highly secure encrypted network.

We are using Zoom for virtual meetings and are happy to meet anytime.

We are here for you.

-Adam Probolsky, President
mobile: 949-697-6726
email: adamp@probolskyresearch.com