Tuesday, November 17, 2015

Business Architecture - Validating Workflows

I feel like I don't use enough random clipart.....
This was found under "sharing" in MS Word 2010.
You're welcome.
Once I have a few process workflows completed and the members of my team are happy, the next step is to show them to others.

I don't need all of them.  I just want to show a few examples of the "least challenging" and get a better feel for how much these stakeholders want to participate.  And I want to do this really quickly so I get input before I get too far in the process.

The workflows  are meant to be conversation-starter.

For the process itself -  "This is what we are doing?  What's your process? What's working? What's not? What would you like to be able to do?"

For architecture in general - "Is this something you would like to participate in?  Is there something you would love to see coming out of this effort? Does this flowchart format make sense to you without me explaining it?  Are you interested in seeing some of the other work we are doing to make sense of our environment?"

If all goes well, these little bits of outreach and relationship-building is the start of a beautiful relationship.

When having discussions with the other trainers, I have to be really careful about couching this as just our process. I don't expect them to adopt it or want to use it or even that it will work for them.  Just a conversation.

This is where coming from the IT department, honestly, makes this conversation a bit more hazardous.  The last thing I want is to have the other training teams feel like they are being forced to do something because "that's the way IT does it."  That never goes well.

Thursday, November 12, 2015

Business Architecture Sample - Student Registration Into Archi

Last spring, after the Integration SWAT Team guy showed me Archi and walked me through how to develop a process using Archimate, he sent me off with a copy of the enterprise architecture as it currently exists (not including specific server IPs or other sensitive information that I don't need anyway). a link to Archimate, a couple of work samples, and the invitation to ask him any further questions.

THIS is why you want to make friends with your IT folks.

Huge swaths of things I had planned to do, he had already done.
All I needed to do was fill in the blanks.
I took my Visio version of the Classroom Trainee Registration workflow and began to convert it to Archi.

And here....I started to run into issues.....

A side benefit of learning another language - whether it be cultural, programming or modeling - is the chance to look at something in a completely different way.

In my attempts to fit this workflow into this tool, I'm having to think about other ways to communicate this workflow.

Unfortunately, I also ran into some big problems with trying to cram a particular workflow into a particular modeling language.  Hence why this post has been sitting in my draft queue since last spring.

After much thought and head-banging, I came to the following conclusions:

1) Just because I am learning a particular modeling language and want to communicate in that language doesn't mean anyone else understands what I am trying to communicate.  It's like saying "I'm learning Spanish, therefore I am going to speak to everyone in Spanish whether they understand me or not."

2) Modeling languages have types of workflows that work best in that language. 
- Archimate is best designed for technical architectures
- BPMN (Business Process Modelling Notation) is best for business process workflows

I have personally decided to prioritize speaking / modeling in the stakeholder's language. 
I want someone to be able to look at the picture and follow along easily.
I want someone to quickly see what is a human step and what is a computer step.
If that means using stick figures and little clip art people, then so be it. 
Besides - stick figures communicate a lot.
And, frankly, it's easier for ME to understand too.

Tuesday, November 10, 2015

Sample Solutions Survey or....How Training fits in

I've had a number of people ask me recently about what questions we are asking in our Pilot surveys.

The largest survey we did was for our Unified Communications rollout.

I have started to use some of these questions during other implementations to get a feel for how the training programs impact the adoption of a new tool.  These surveys are being sent out one month after the implementations. 

We have found that we get a better idea as to whether the solution and the training that supports the solution worked. People have had time to work with the new solution and processes. Patterns as to what is being used and what isn't are beginning to surface. Plus, I find I get more honest answers from people one month out. 

The general questions we ask:
  • How helpful did you find the training materials?
    • We then list each individual training object (each type of classroom training, each tutorial, each quick reference)
    • Helpful / Not Helpful / Did Not View or Attend
  • What other resources did you find helpful as you learned how to x?
    • This is a free-text field
  • I find x intuitive and easy to use - Yes / Somewhat / Not at all
    • x = the IT application
  • As a result of the training, I felt I could use x - Yes / Somewhat / Not at all
    • I have generally found that for Somewhat and Not at all - people will add comments without prompting
  • As a result of the training, I could use x to perform y tasks - Yes / Somewhat / Not at all
    • This question can be separated into the different type of tasks if the solution was modular
    • Again, people will generally add comments without prompting
  • As a result of the training, I felt I understood (any resulting new process / concept) - Yes / Somewhat / Not at all
    • We will add this question when there is an affiliated major process change. 
    • The question also helps us to see whether we did a good job putting the material in context
  • The training applied to how I need to use x to do my job - Yes / Somewhat / Not at all
    • Another question asking whether we got the context right
  • What features do you find you use most often, check all that apply
    • For new IT applications, this gives us a feel for what people are actually using
    • This also gives us information for where we need to do more training, or ask more questions as to why they are not using a particular feature or area we are expecting people to use
      • Depending on the sensitivity of the audience, this question is best done with clear identification vs anonymously.  This provides a better feel for whether we got the audience needs assessment right if we are working with multiple audiences.
  • Rate your understanding of the following subjects as a result of this implementation
    • Here we check to see how well we covered the individual areas 
    • We used a Likert scale ranking from I understand to No understanding + Does Not Apply to Me
    • We are able to see what may require more training and whether we captured the appropriate audience.
  • What topics do you wish were better covered? - Free Text
  • How can we improve the training and support for implementations like this one - Free Text
  • What improvements do you think we can make to (the resulting new process) - Free Text
    • We had one question for each major process that was affected by the implementation
  • Any other comments or would you like someone to follow up with you - Free Text

These surveys have really helped us get a better feel for how the training solutions we design are helping (or hurting) implementations that (hopefully positively) impact the business.

If you see other questions you think we should be asking - please add them to the comments.

Thursday, November 05, 2015

Translating Capabilities to Strategy - Survey example

As you may have discovered, we have multiple tools that do similar things.

We have multiple tools that provide survey capabilities.

So now we can sit and figure out what tool is best for a particular scenario - and come up with a clear set of guidelines for the team.

This will allow us to better evaluate what is actually being used, whether we should be using one of the other tools instead, and what is not needed.


In this example, I have taken the capabilities and developed a strategy based on careful evaluation of those capabilities. 

The most salient requirements and capabilities I used to create this are
- Reporting and my audience for reporting (higher the level, the prettier the pictures need to be)
- Whether I have to (or can) connect a survey to a particular learning object
- Whether I can create anonymous surveys

The most difficult part of this exercise is defining the scenarios. I just listed the ones I either encounter frequently or have seen recently. 

Like other educators, we commonly use survey tools for smile sheets, testing and pre-testing.

However, we've also been using surveys to help us see measures of whether particular solutions have been creating change and the role of training in that change (the Solution surveys).  Those surveys are not connected to a particular course - so using the LMS survey tools (which forced me to connect a survey to a particular item) was out of the question. 

I also have a Skills survey scenario. One of my projects last year was to do a skills inventory for a segment of our division.  This helps us see what human capability we had in-house and how it potentially measured up to certain planned activities.. From that exercise, I learned why vendors have expensive skills evaluation solutions. 

Again, the way I approached (requirements to capability to strategy) generally occurs in Wendy's Utopian Fantasyland.
The reality normally looks like this.

Tuesday, November 03, 2015

Translating Requirements to Capabilities

We have talked about Capability Matrices before.

Application Architecture: Capability Matrices
Where do I stash my files?
Capability Matrices: Functionality Replacement

Doing the translation between requirements and capability is actually fairly simple:
1) Copy the actor/verb/object columns to a new sheet within your spreadsheet
2) List the tools you have available across the top
3) Ask - does it have the feature? Yes / No.  This also allows me to comment if the answer isn't so black and white.

Example of an incomplete capability matrix is below.

This can be used either for applications that you have existing in the environment (like the one shown here) or ones that you are evaluating.

In this instance, we are looking at the capabilities that are in our environment.

Notice that this is incomplete.  I still need to sit down for a quality day and go through each line for each tool.  It'll happen....eventually :)
You will notice in this particular requirements / capability matrix, I have also added any survey / assessment / evaluation capabilities housed in LMSs.

Mostly because often when training groups use surveys, they are in the context of a particular course (smile sheets, tests etc.).   Once I get a full evaluation of what each one of these systems has - I can then start putting together a use strategy.

ie - I use Google Forms when I am trying to do x for y audience.  I use SkillPort when I am trying to create a test attached for a particular course for staff. etc.  I'll flesh that out later.

Monday, November 02, 2015

Translating Capabilities into Strategy - Content Strategy

Of course, life does not always provide time to come up with a strategy after careful consideration of requirements and capability.

Sometimes, you just have to rely on prior history and gut feeling - as well as take advantage of opportunities as they present themselves.

Behold! Our current content strategy!

I can use this both for my own reference (where should I stash my stuff) and for the rest of the team (where should they stash it too).

To create this, I had a working knowledge of the bits and pieces we had been using so far and what we did.  In Wendy's Utopian Fantasyland - there would have been detailed requirements and capabilities much like with the survey.  Um...yeah...didn't have that.

I also tested some functionality with the movie files to see whether the proposed solution was feasible (otherwise known as spending time storing and retrieving movie files in various places to see what happened).

This document was created in response to a gap I had been complaining about for a year now in regards to our functionality - ie, where do I stash my movie files if I am not supposed to stash them in our designated document management system or on my YouTube account?

It was also created in response to a sudden proliferation in places where we COULD stash our stuff.  Before we had our LMS (for stuff requiring tracking), our little corner of a web server (for interactive videos that did not require tracking), and a shared drive.  Now we have a lot more options and places to put things.  It got complicated.

The headers were in response to the key capabilities and scenarios I encounter in this space:
- What type of file or file package am I creating?
- What type of reporting do I need?
- Who is the audience?
- Where are we stashing this file?
- Other concerns or issues that have surfaced around this solution?
- Potential next steps?
- New / temporary solution options as we hash stuff out (the unlabled column)

Eventually - there will be a detailed requirements and capability matrix for this space much like the Survey requirements.  Eventually.....


Thursday, October 29, 2015

More Historical Perspective or Why I Fear for Instructional Technology as a Profession

This is one of my first web sites - developed in 2001.  I chose the topic because it was controversial (still is) and it allowed me to use lots of pictures in buttons.  Because in 2001, that was advanced.

Note the matrices and the fact that the instructor printed out every page of the web site.

As I sifted through my papers from my Instructional Technology Masters degree, it occurred to me that we are having the same conversations that we did in 2001.

Despite lots of research, we are still designing the same stuff.

Still asking how we can develop the same stuff FASTER vs how we can design effective solutions that better map to the way people learn and the environments we work in.

The solutions I see now are very similar to the solutions I saw back then.

Because when we are actually faced with having to DO something, we revert back to the same habits.

Thinking in terms of courses.
Thinking in terms of how fast we can develop a course vs whether a course is an appropriate solution in the first place.
Thinking in terms of "training" vs helping people become more comfortable with change.
Thinking in terms of events vs the small, distributed experiences that are proven to work.

We have over 15 years worth of research - people!!!!

Let's use it!!!!!