Badge types: different strokes for different folks

This is a long, nerdy analysis of badge types, but it does have some quickly scannable colourful graphics and it does highlight new entries like 1EdTech’s TrustEd Microcredential and ASTM’s recently published standard for Competency-based Workplace Learning Programs.

It picks up on a previous post, where I shared the Learning Agents Adaptable Badge Taxonomy for community feedback. In this post, I update that taxonomy and compare it to other frameworks out there.

About badges…

To avoid confusion with this post, it’s important to lay out some basic concepts about badges, such as:

A badge is NOT an award that is either too small or not “good enough” to be a micro-credential

… despite what others might tell you.

Digital badges are flexible digital credentials that can represent a wide variety of use cases. Their scope is limited mainly by the imagination. Digital badges span the full spectrum of recognition from formal through nonformal to informal, including professional licences and certifications, diplomas and other macro-credentials, for-credit micro-credentials, non-formal workplace training badges and many, many, many other use cases for recognition of learning and achievement that can be lifelong and lifewide.

Digital badges = containers for claims

As with shipping containers, you need to pay attention to the manifest, check the contents and pick up on other clues, like the idenitity of the originator: does it contain something unique and useful, or is it “same old, same old” or is it just recycled plastic trash? Note that the claims don’t need to be formal or high stakes, but they should be clear, relevant to the context and well supported.

When people say “digital badges” they usually mean portable digital credentials that are created and issued using the Open Badges standard, i.e. not gamification stickers, like Khan Academy’s or proprietary website-specific badges like those from LinkedIn Learning or LinkedIn Skills that serve their business model and skills graph needs rather than supporting a recognition ecosystem (stop ranting, Don).

It’s also really important to say this:

micro-credential ≠ course

A micro-credential can certainly be a course certificate, and that’s an all too dominant use case, but it’s important to remember that there are many ways to learn and develop and many ways to recognize learning and development that go way beyond training courses. And badges can handle them all, given the right mindset. So, for our purposes in this post:

micro-credential = (non)formal badge awarded after summative assessment

.. ie micro-credentials inhabit the formal end of the recognition spectrum. Summative means partly that it should be possible to fail. They can be for “formal” for credit or “nonformal” non-credit, but possibly high stakes (e.g. for career). I’m leaving out for the moment notions of quality, qualified issuer, industry relevance, etc., to avoid turning this blog post into a sequel to War and Peace.

Ultimately, done right, badges are more than stickers or certificates – they can tell authentic stories of learning, achievement and aspirational learning journeys.

Feedback & updates to the Learning Agents taxonomy

When I posted the Learning Agents adaptable taxonomy of badge types for community feedback back in February, I did get lots of feedback, so thanks for that!

Noah Geisel’s feedback gave me the most pause – he worried that having defined “buckets” for badge types could be misinterpreted by many as being prescriptive (it MUST fit into one of these buckets) rather than descriptive and adaptable “popular spots along the spectrum”, which was my intention.

So here’s a metaphor that might work better: “spaces” in a co-working facility with adjustable walls. I hope I heard him well when I adjusted my walls here:

Diagram showing a spectrum of recognition from formal on the left to informal on the right, with examples of badges along the way
Learning Agents Adaptable Taxonomy of Badge Types 2024-03-24 CC BY

Some notes about the above…

Emphazing continuity and remixability

Basically, I made the buckets look more like adjustable “spaces” and added double-pointed arrows between the spaces, indicating that they can morph into each other and be combined/stacked into each other in diverse ways. It’s also possible that a less formal badge can be formalized, through a kind of PLAR-like endorsement. For example, my colleague Serge Ravet hopes to be soon working on a project for home care workers that would see informal recognitions of practice (badges) transformed into nonformal and even formal recognition. But I suspect it’s easier to develop a more formal badge by submitting less formal badges as evidence, perhaps supported by other evidence, reflection and/or endorsement… transformation as repackaging with other elements.

This “space morphing” can work quite well for the less formal badges, but there are industry standards out there for many course certificates and certifications, even beyond academic certification standards, so those spaces are a lot less flexible: the walls tend to have structural steel or concrete in them, and the diagram reflects that.

Lumping vs splitting

I had recently lumped (merged) the Completion and Participation spaces into Organized Learning. In the feedback I got, some felt that this type was now confusable with Assessed Learning, so I’ve made it more explicit as Organized Unassessed Learning, which can include things like events. Of course, in the spirit of adaptability, some may choose to re-split these sub-types into separate types again for their particular context.

I went the other way with the Performance space, splitting that into:

  • Evidence & Demonstration: examination at a particular time (SHOWS, in Miller’s Pyramid)
  • Performance: behaviour over time (DOES, in Miller’s Pyramid)

Opinions may differ; if so, merge away!

Flexing the flexible

I’ve also now added more detail to the Flexible Recognition space, building out examples in areas like community recognition and self-declaration, but this is definitely not an exhaustive list! The idea here is that informal recogntion can be VERY useful in many cases, such as:

  • Learning who’s who in a community of practice (e.g. ambassador, guru, mentor, newbie)
  • Developing authentic, supportable self-declarations to behavioural interview questions (greatest strength, achievements you’re proud of, stuff you’re working on, goals for your career, etc.)

I have another slide where I provide lots more examples along the spectrum, but I won’t bore you with that now – maybe later!

Comparing the Learning Agents taxonomy to others

This is the fun part and was actually the trigger for this post.

I’ve been very pleased to start seeing more attempts to differentiate badges, amid what’s frankly been an all too pervasive Monsanto-esque micro-credential monoculture. These new efforts start getting us away from false binary choices like badge vs. micro-credential and begin exploring interesting nuances in formal/nonformal/informal recognition. A good example is Scouts Australia, a Registered Training Organisation that is nationally accredited to award vocational qualifications. Jeffrey Lehrer shared a Six Sigma inspired typology at the ePIC 2023 conference last December, and repeated it in a March 13 session of Open Skills Network’s Open Recognition Workgroup (link to March 13 recording):

Table showing levels of formalization of recognition, following a Six Sigma inspired coloured belt system.
Scouts Australia (shared at ePIC 2023)

and even the 1EdTech folks, who admittedly have enabled a lot of “in the box” micro-credential/transcript thinking since they took over the Open Badges standard… but see them here making an attempt to differentiate between Knowledge and Application, albeit in a fairly restrictive boxlike “TrustEd” way, that lumps everything else into a “non-trusted” category and has no provision for learner self-declaration:

TrustEd Microcredential Frameowrk

(Version 1 – I’m hopeful that it will improve.)

As a reminder, I published the Learning Agents taxonomy based on some co-creation for the Inter-American Development Bank’s IDB Digital Credential Framework:

Badge taxonomy for individuals and organizations
Inter-American Development Bank

It’s worked out well for them and their framework is now being adapted by Team Democracy for the civicscredentialing.org badging system that’s being developed in the US. Here’s a preview of that:

Another badge taxonomy for individuals and organizations
Civics Credentialing – Spectrum of Recognition. Work in Progress, shared with permission

I need to also need to acknowledge the very practical workflow developed by Lesley Voigt in late 2019/early 2020 for Madison College Digital Credentials Institute’s Digital Badge Taxonomy:

A badge taxonomy for individuals, comparing formal to informal badges
Madison College – Digital Credentials Institute.

It’s also important to mention at least some of the industry standards out there for assessment and recognition:

Various pundits are becoming fond of saying that “micro-credentials are not new” and indeed that’s true: they’re typically course certificates in colourful new Spandex suits.

So certificate and certification standards are important elements in an inclusive taxonomy and many regulatory, professional and industry bodies have been using these standards for decades. The list above highlights a very recent new addition in italics, which my colleague Jeremy McQuigge from CAWBL believes should be labeled Work-Based Learning or WBL, but that’s another post, maybe from him! I’m still working my way through the new standard and seeking feedback from knowledgeable colleagues like Jeremy.

I haven’t included Quality Matters or other academic accreditation systems, because I’m trying to take the badge/recognition dialogue beyond the ivory tower.

Analysis

This is a big list of things and hard to visualize all at once. So, being the “opening up recognition” nerd that I am, I thought it might be fun to cram everything I could onto one slide:

Learning Agents Taxonomy compared to a selection of other frameworks.

You need to select the image to view it full size.

I was going to add lots of arrows to connect things, but that would have made things even busier, so I decided to try analyzing them in a table to check for gaps, overlaps and any new ideas that might pop up:

Some notes…

I think the Learning Agents taxonomy holds up pretty well overall – of course it’s very similar to the IDB framework from where it draws a lot of its inspiration, but it’s also great to see Scouts Australia call for self-declared assertions. And the Madison DCI taxonomy is also holding up pretty well, although again no self-assertion. I wonder why 1EdTech’s TrustEd Microcredential Framework didn’t include it? I do note that Madison College doesn’t seem to be a member of 1EdTech, so that may be a factor.

Those four top rows have the best coverage across the scope of recognition. More than a single flavour micro-credential, certainly.

I’d love to see more about capturing and recognizing Work Based Learning. I’m hopeful that organizations like the US Chamber of Commerce Foundation and the Council for Advancing Work Based Learning can help.

And I don’t do any analysis here of team, group, organization or community badges – these increasingly important, but for another post.

Looking forward

Part of the reason I’m diving so deep into all this is that we’re starting to do a lot of work in adult learning in French Canada, alors mon français est en train de s’épanouir… 8->

That community is currently abuzz with an amendment to the Official Languages Act that just went through on January 1st of this year. Here’s a clipping from the gc.ca website:

Quality lifelong learning opportunities for linguistic minority communities that can be formal, non-formal and informal… wow.

It sounds even better in French:

…faire des apprentissages de qualité, en contexte formel, non formel ou informel, dans leur propre langue tout au long de leur vie…

Or, as Mona Audet, a community leader from Manitoba improved it at a recent national summit:

Tout au long de leur vie et tout au large de leur vie

Mona AUDET, pluri-elles, Manitoba

Lifelong and lifewide learning. I can understand why they’re excited, it kind of makes me want to move back to Quebec as an Anglo. So, believe me when I say that they are ALL OVER the notion of opening up recognition. As just one example, see how the Ontario Coalition for Adult Learning (COFA) is piloting evidence-based badges for adult learning practitioners that align to a recently developed competency framework for the workforce. Not courses, but packages of evidence or « preuves », as they call them, in this case submitted for assessment by competent professionals.

There’s another badge system being developed for community learning implementation in several provinces called Familles engagées that engages entire families in projects to improve their local communities, activating their lifewide skills and capabililties (and sense of self-efficacy and citizenship) in the process. And recognizing that.

I’m very happy to be working with these communities on this inclusive approach to lifelong, lifewide learning. For myself, this is also a great opportunity to renew my own lifelong learning relationship with French – that’s a story in itself, that I may well tell in a badge sometime… 8->

Updating the Learning Agents badge taxonomy

I’m seeking feedback from all you awesome people in your various recognition communities as I update the badge taxonomy that Learning Agents uses for its various consulting projects in Canada and internationally, and for support of clients using the CanCred.ca badging platform. Also, wearing my Advocate hat, it has supported my rants about opening up recognition, regardless of platform. So, tactical and strategic utility for me, wearing my various hats, and for others too – at least so they’ve they’ve politely said to me (many are Canadian, after all.)

Thoughts – clarification or complication? Flexible and inclusive, or complex and rickety?Feedback welcome, whether on my blog or on LinkedIn. Help me make this better!

Update to Learning Agents’ “Adaptable taxonomy of badge types” — DRAFT, for community review

Significant updates to the Learning Agents taxonomy

  • Creating a new type, Performance, based on recent work by Chris Newlon of TeamDemocracy.org (see below) and my increasing interest in 70:20:10 model for development that shifts the focus from training to performance
  • Merging Completion and Participation into (unassessed) Organized Learning, also inspired by Chris’ work above
  • Renaming Demonstration to Evidence and Demonstration
  • Forking the Assessment “frontier” to indicate that both Evidence & Demonstration and the new Performance category could be assessed or not assessed, depending on fitness for context
  • Hinting at a new category of badge types for Teams and Organizations, thanks to Stella Porto of Inter-American Development Bank from our work together last year

Background

The trigger for this new version is some exciting credentialing work that’s getting underway for adult learning in French Canada, not only in Québec, but supporting lifelong learning and skills development in minority francophone communities across the country.

I’m helping several of these organizations get started with badges for adult learners and for the professional community that serves them. Some early badges I’m designing are for a project for family learning in in Manitoba, and an upcoming National Summit on Learning for Canada’s Francophonie, which is sponsored by the Canadian Commission for UNESCO. One of the stated objectives of the Summit is (my translation, with the help of DeepL):

A collaborative digital badge accreditation system for non-formal and informal learning recognized by formal institutions, community development organizations and workplaces – a tool developed BY and FOR Canada’s Francophone minority communities.

Translated from RESDAC.NET

The badge taxonomy has gone through quite a few iterations, probably beginning with HPass.org back in 2017. I’d say the most significant version so far was for the IDB Digital Credential Framework in early 2023 that I co-created with Stella Porto:

Taxonomy from the IDB Digital Credential Framework — 2023 CC BY

…. which I adapted to the more generic one that I’m updating now. This taxonomy feeds into the badge templates that we provide for CanCred customers and consulting clients. They’re models for well-constructed badges that fit into the taxonomy, which people can use as a starting point, instead of being confronted with a blank canvas. Or I guess ChatGPT, these days.

Anyway, I’ve been madly translating those badge templates into French (with the help of real human French speakers), and it’s been a chance to re-examine the Learning Agents taxonomy.

I mentioned above that a recent influence has been the great work that Chris Newlon of TeamDemocracy.org has been doing in adapting the IDB/Learning Agents taxonomies for their prototype Civics Credentialing System, designed to help achieve their multi-organizational mission of rallying all Americans to a shared identity, and a shared commitment to democracy. So Civics Credentialing is not just about assessed learning and certification, but also engagement, commitment, action and community recognition. Here’s how I shared their draft taxonomy at a recent career conference in Ottawa:

Team Democracy: Civics Credentialing Badge Image Language — DRAFT 2024, shared with permission

Another influence, also mentioned above is 70:20:10, which I’ve used before in my frequent rants about micro-credentials as old-school training certificates in new digital clothing.

From a previous blog…

By the way, I’m trying out this new riddle about micro-credentials:

Q: What is a micro-credential?
A: Whatever the funder says it is.

Anyway, all feedback welcome, even about micro-credentials (notice that I do include them…) before I republish the new version of the taxonomy and update the badge templates.

Thanks!

The case for making badge metadata better

“Say what you mean – mean what you say”

<rant>

Recently I saw one of the worst examples of a micro-credential badge in Canada that I’ve ever seen, and I’ve seen lots of micro-credentials – not all bad mind you, despite my own reservations about micro-credentials as a credentialing monoculture.

When I responded to the invitation from someone on LinkedIn to “View my verified credential“, here’s what I found. In the LinkedIn post, I saw:

  • Impressive logos: the prominent PSE institution’s logo, the institution’s business school logo, even the prominent client’s logo
    (A bit noisy, but OK..)
  • A badge title that linked leadership to emotional intelligence.
    (Promising…)
  • A big label saying something equivalent to “Fundamentals”.
    (So nothing too onerous, but there’s lots of room for different types of learning.)

Viewing the hosted credential on the badge platform, I found:

  • An Open Badge that was indeed verifiable
    Open Badges is the technology standard behind most micro-credentials
  • A couple of visual labels saying “Learning” and “Fundamentals”, with no links or any other context
  • Three short “skills” terms
    Originally harvested from job ads, two of these were defined automatically from Wikipedia (unattributed), one was undefined. They’re linked to Labour Market Information (US-based by default, but customizable). These are usually provided as prompts for badge creators to pump up the value of their badges by linking them to “real jobs”. Practically speaking they’re usually more useful for technical skills than soft skills like leadership and EQ, largely because of that definition problem, but also the difficulty of assessing soft skills equitably.
  • Description: (what does this badge say about its holder): Something pasted from the course description about “designed to help [WRONG ClientCompanyName] managers “gain insight” into..(how they relate to EQ as leaders).”
    Wrong. Company. Name. Has anyone else noticed this yet?
  • Criteria (i.e. what does it take to earn this badge): the “beating heart” of the badge:
    “Completed [RIGHT ClientCompanyName]:[CourseName]”
    One sentence? That’s all? What were the topics? The learning activities? Was it 1 hour or 3 days? What were the outcomes? Were those outcomes assessed? What evidence of application? What does all this add up to?

Just imagine, as I did:

  • From the front, a chestful of impressive medals, like you might see on a North Korean general
  • From the rear, a partially open clinical gown, like you might see walking behind a patient in a hospital corridor (no link provided!)

Now try and get that image out of your mind. So far, I haven’t succeeded.

This is a good example of why it’s important to think beyond pretty looking badges with fancy logos, superficial titles and undefined skills terms and really take on board the key message that “there’s data inside” these things:

From openbadges.org, stewarded by 1Edtech

What if people (say, employers) actually look inside your badge to evaluate your skills and learning data? What are they going to think? Dan Hickey, an early thought leader in the open badges space, liked to say that employers and other “consumers” of badges would “drill, drill, drill” the first time seeing a provider’s badge, then just “drill” the next time, to confirm their first experience, then for further badges maybe not drill at all, after familiarity and trust have been established.

But how much trust do you think has been built by the badge I described above? More to the point: how much damage has been done to the brands of the organizations involved?

Maybe this was a good course, great even, but how would we know? The poor quality of the credential is definitely not a good sign. A badge is a chance to tell an authentic story about learning and achievement. This was not much more than an empty headline.

This is NOT about badging platforms – they all do 80-90% what each other do, and mostly compete in other ways. This really comes down to the organizations involved. The issuer organization didn’t care enough to do more than copy and paste from an old badge without checking their work. The client organization didn’t care enough to complain. The person who shared the credential probably doesn’t really care – she’s likely close to retirement and no longer so concerned about career advancement. But a younger, hungrier colleague looking to become a leader would care. Would they proudly share this badge?

This is also NOT about micro-credentials versus digital badges. I bet the issuer would claim that this is a micro-credential, despite the lack of information about assessment. It’s just not a good micro-credential. (I’d probably call it a Participation or Completion badge, but that’s for a later post.)

This is really about managing expectations and building trust in your credentials using:

  • A transparent framework that declares your values, states your purpose and describes how you will achieve and maintain your purpose
  • A clear taxonomy of the different types of credentials that your framework covers
    (HINT: more than micro-credentials vs “digital badges”)
  • Solid information requirements for each type of credential in your taxonomy, whether it be formal, non-formal or informal, that are fit for purpose. Not all badges are micro-credentials, but the ones that ARE should meet expectations for that type
  • Delivering on the above in a demonstrable way
  • Improving on the above over time

You don’t need to wait for the final definition of micro-credentials to come down from Olympus before you start to take a more structured approach to your own credentialing efforts. Heck, Canada still doesn’t have a national qualifications framework.

And you don’t have to have it ALL figured out before you start. It’s OK to have something that’s at least better and more responsive than what was there before, even if it’s not yet perfect. It’s OK to learn, change and grow, just like our lifelong learners do, because we are all lifelong learners and change is constant. But let’s be clear about what we’re trying to do and how we’re doing it.

In a later post, I’ll go into more detail about frameworks, taxonomies and “Critical Information Summaries“, based on some recent research consultations and implementations I’ve been working on, but I’ll save that for a later post. This one is long enough!

</rant>