Wednesday, 31 October 2007

Flattered - Really?

Donald Taylor was kind enough to choose me as Blog of the Week with some flattering comments, but he also made me laugh...
You’ll notice a passing resemblance between Tony’s photo and that of chisel-jawed motivational speaker Tony Robbins. I am assured that they are no more related than I am to suave master spy Roger Moore.
I've put relevant photos below. Uh Donald, ...




Tony Karrer

Tony Robbins

Donald Taylor

Roger Moore

LMS Team Size and Time - Wow 23 Months!

Steve Wexler from the eLearningGuild's research group just helped me get into some interesting data around Team Size and Time during an Learning Management System Selection and Implementation process.

So, this post will end off the series of posts I was doing on LMS Selection as a precursor to my DevLearn presentation. The other related posts are:
Other posts on LMS:
Shoot - I don't have one specifically on the concept of a Starter LMS. I need one of those. Note to self.

This post focuses on what your Team will look like and how long it may take you. First of all, the survey of guild members broken the LMS Selection Team a bit different than I do. And I believe they were asking on core team only. Second, the LMS Selection Process in their report ended up being considerably different than mine. In particular, they asked about six steps:
  1. Gather and Specify Requirements
  2. Research Vendors Requirements
  3. Meet with Vendors
  4. Install and Configure
  5. Customize
  6. Implement
Steve is working on combining Steps 1-3 and Steps 4-6. Still even with that you really would want to know things like:
  • What's the difference in time if you customize or don't customize?
  • What's the timeline with Large Enterprise LMS implementations vs. smaller implementations? Or based on particular vendors?
  • For people who considered this particular feature set important, how long did it take?
Still the scatter plots that show Team Size and Time Taken for each step is interesting and informative. I chose to limit my graphs to Companies with 2,000 or more employees having more than 1,000 learners involved in the implementation. Here's what I saw:

Note: larger circles indicate more answers.

There are some notes scattered below. Overall, it appears that it roughly takes:

3.5 people about 23 months to get things implemented. Wow, 23 months! By then, you are likely wrong about your requirements and the system you selected. Maybe you should have gone with a Starter LMS.

1 - Gather and Specify Requirements

Median - 3 people, 5 months



2 - Research Vendors Requirements

Median - 3.5 people, 4 months



3 - Meet with Vendors

Median - 3.5 people, 2 months

Note: people aren't spending enough time during evaluation doing hands-on evaluation. I have not idea how this can be shorter than researching vendors.



4 - Install and Configure

Median - 3.5 people, 4 months



5 - Customize

Median - 3.75 people, 4 months
Note - there should have been more 0,0 values. Isn't it time for us to stop customizing?



6 - Implement

Median - 3 people, 4 months

OpenSocial Platform

Well, we finally are starting to hear what Google's anticipated response to the fact that Facebook Platform and Facebook as a Learning Platform. The real beauty of Google's approach is in the word "open." With Facebook you are somewhat forced to make a hard choice about rewiring your application to live seamlessly within the Facebook environment or pushing Facebook users across to your site which is a bit ugly. Further, you face the prospect of having Facebook rework aspects that you are leveraging.

So, as I mentioned before, I'm a big believer in leveraging the knowledge of social connections that exist across the network of different applications (e.g., del.icio.us, flickr, MyBlogLog, Facebook, LinkedIn, your email, discussion groups, etc.). Google appears to be headed down the direction that will allow applications to take advantage of that knowledge.

But I'm still back at my same question:

I'm currently in process on two Facebook applications that leverage that platform for viral expansion via Facebook, and I'm working on the design of several new or extensions of existing sites/software solutions that will leverage social aspects. The questions are:
  • Do you leverage Facebook because of installed based and easier, known viral adoption model even though you are locked in?
  • Can you justify building out your own social graph (friends, groups, etc.)?
  • Do you head towards Google's OpenSocial even though you may be ahead of your users?
Answers seem to be fuzzy and turning out different in different cases. I'm hoping to hear more from other folks about what they seem happening.

Tuesday, 30 October 2007

DevLearn - Let's Meet

If you are attending DevLearn and you are reading this, please let me know by leaving a comment or connecting with me in some way. It is always nice to meet with readers and other bloggers at conferences.

Lost in Translation

Generational differences have been on my mind lately because in my job, I deal with it all the time. The classic scenario is a parent or teacher of the Baby Boom or Gen X parent or teacher being frustrated with the Generation-Y kid’s behavior. The kid always text messages in class, or they spend all their time on the computer or X-box instead of doing homework, and the list goes on. Most parents are pretty computer literate now, but I once worked with a family whose kid was a computer genius and the mom didn’t understand that a mouse is used with your hand. She had put it on the floor like a sewing pedal. I’m serious. Now that’s a generation gap. But chances are, if you are reading a blog, you’re pretty tech savvy already.

In fact, this may be you:



Now the reality is, you don’t have to know all the fancy tech talk to relate to your kid, and your kids would actually be horrified if you used it in your daily vernacular. Remember when your mom caught on to a popular phrase and then it was ruined because it was no longer cool now, because your mom was using it? But it’s great if you have some awareness of what your kids are talking about. And there’s the fine line. There is a big difference between knowing about My Space and have the talk about online safety and scouring the Internet for your kid’s My Space to see what s/he is doing and feeling 24-7 (the 21st century equivalent of reading your kid’s diary every day).

Here are some of the top fears parents have told me regarding online use and social networking sites, such as MySpace, Facebook, Youtube and Xanga:

My child will be exposed to cyber bullying I admit, after looking at YouTube and MySpace and all that, I’M SO GLAD THE INTERNET WASN’T AROUND WHEN I WAS IN SCHOOL. I’ve been called into many a meeting in which a fight at school originated with MySpace content. One of my colleagues even had to deal with a teenager who photo-shopped another girl’s face on a pornographic photo (looked totally real, by the way). The other girl found out and got her older cousin to cut the other girl’s shirt in the hallway so it would fall off. *insert curmudgeon voice here* In MY day, we just wrote notes about which girl we didn’t like. It wasn’t as publicly humiliating. My advice is to treat cyber bullying the same way you would any other type of bullying.*

Inappropriate Postings I have Googled people’s names to get contact information and found the most interesting things—their personal blog detailing their *ahem* extracurricular activities, articles they wrote 10 years ago, an online budget from a school detailing how much money they make, and so on. A friend of mine once typed in someone’s name to find a wedding registry and found an article about how this person’s husband-to-be was arrested in another state with all the details. Parents (rightfully so) are worried about the long-term consequences of their children posting personal information for all to read.

The message is to have the conversation about how MySpace is everyone’s space, including future employers and colleges. Inform your child that you will respect their privacy while on the computer, however that their safety is most important and that you will intervene if you feel it is necessary. The good thing about the online issue is it is a great jumping off point for discussing ethics of downloading music, how to evaluate the reliability of online information, strategies for handling online harassment, or getting emails from strangers. It’s the 21st century equivalent of our parents telling us not to give out personal information or take candy from strangers.

What you do not want is to be hovering over your child’s shoulder while they are on the computer or go on and on that the Internet is full of sexual predators and danger. Be inquisitive and knowledgeable, but not intrusive. The message you want to send is that you are open and available for conversation about online safety. Chances are, your kid probably already knows how to hide his/her profile from others who s/he doesn’t know or isn’t in their friend network. But you have presented that you are available if something comes up.

They spend too much time online: This one is a biggie. Without fail, every meeting about lack of homework completion leads to a discussion about how the kid is spending their time online instead. And just what are they doing? Well, a recent survey showed that most online teens are using social networking sites to stay in touch with close and distant friends and to make new friends. It’s the 21st century mall.

To continue the theme of building rapport with your teen about online activity, discuss an “Acceptable use policy” with them. It’s not about laying down the law, it’s about allowing appropriate use unless there is a decline in grades, severe change in emotions, or physical symptoms such as back pain. Remember that computer use can be good too. There are many sites that can be helpful for finishing homework, learning how to do new things, engaging youth in the political process, learning new languages, and friendship building.

Ok, TTYL8R. I’ve spent far too long on this newfangled Internet today.

*I will definitely have a follow-up post on bullying and relational aggression with tips for parents and educators. So you have a nice context, in the meantime, go ahead and rent Mean Girls unless you simply cannot stand to see Lindsey Lohan’s face one more time.

Portions of the content for this blog came from a recent Bay Area Parent magazine article by Jennifer Shaw-Hurd. See, I’m modeling how not to plagiarize.

Sunday, 28 October 2007

Psychologist vs. Puppy

We got a puppy. You know what’s a lot of work? Puppies.

My fiancé and I have been following this puppy around, armed with my behaviorist training, treat bag, and training clicker. When we see something we like, we mark it with a click, and reward it. Here is my life right now:

Sit. click Yes! treat
Down. click Yes! treat
Drop it (dustpan, sock, shoe, pillow, etc.) click Yes! treat
Look at me! click Yes! treat

We go to “Demure Dog” class every Saturday to reinforce everything. Our instructor says the dog has ADD. All puppies do. It’s exhausting. Now I know you all think I’m going to draw a parallel between my experience with my dog and human behavior. And yes, I am.* Hey, if Pavlov can do it, so can I.

As a joke, my fiancé and I started using the clicker with each other. He puts away the dishes, and I click and say, “Yes!” I say we can watch baseball instead of watching my show, he clicks and says “Yes!” We are in the House of Positive Reinforcement. All! Positive! All! The! Time!

At first, the clicking at each other was funny. Now I’m actually getting some insights into what my fiancé appreciates that I never knew. He apparently DOES notice and appreciate when I wipe down the counters, put away the laundry, or pick him up from the train station. Who knew? And I never really noticed before that he always takes out the recycling before it turns into tower of abstract trash-art. The point is, we often take for granted the nice things people do for us, and the same goes for our children’s behavior.*

I have had more than one parent say, “Why should I reward my kid for doing what he’s supposed to be doing anyway? That’s just bribing him.” And I ask them this, “Do you like it when your boss notices you are doing a good job instead of always telling you what you are doing wrong?” or “If your boss gave you a cash bonus for a good job, would you give it back because you were supposed to be doing your job anyway?” People like positive feedback and rewards, and kids eat it up.

I worked with this 7th grade student once who was such a “tough guy.” Every positive thing I said to him, he brushed off like he didn’t care. He was in a counseling group I ran for 7th grade boys with oppositional behavior and ADHD (in retrospect, I have no idea how I survived). The group had agreed that each member would get a “Caught You Being Good” ticket for every time they attended group and followed the rules. These tickets were a part of a school-wide positive behavior plan, and got you in a raffle for a $5 prize and your name read on the announcements. Every time I gave this student a CYBG ticket, he shrugged, said “whatever” and shoved it in his pocket. I thought my plan wasn’t working with this kid, but stayed the course.

At the end of the school year, his mom came in to the group celebration and told me that her son had put up every single ticket on his mirror at home in an arch design and couldn’t wait until the next group so he could cover the whole mirror. So even your “too cool for school” kid may also like when you notice good things. Try it out in your classroom, with your husband, co-worker, or your kid and see what happens. It might just be contagious and someone will finally acknowledge your world-famous pot roast dinner or how you always come to staff meetings on time.

And thanks for reading today. click Yes!

*People are not dogs and dogs are not people. Seriously, it’s just a metaphor.

Friday, 26 October 2007

Teacher Vs. Student

Aha. After many painful hours of searching YouTube for awful teacher-student interactions, I found a clip to illustrate how I might do an observation and consult with the teacher. This is a clip from a mockumentary (fake documentary) in England of a teacher-student interaction gone awry. It isn’t that far off from some teacher-student interactions I’ve observed. And if you are reading my blog from work or around small children, you may want to turn down the volume! I apologize in advance for the cursing. But it’s not that uncommon in these interactions, so it stays.



What would you do if you were the teacher? What would you do if you were the school psychologist?

Of course, in reality, I would collect information from the kid’s cumulative folder to see if this behavior is historical or new, observe him in other classes, interview his teacher to get a sense of the frequency, intensity, and duration of these types of incidents, and obtain information from the family if there are any recent stressors in the student’s life or ongoing disabilities that may be triggering his reaction. For the purpose of this post, let’s assume this is a brand new problem that only occurs with this teacher and there are no other external factors causing the behavior. It’s never that simple, but let’s pretend. It’s fun.

Now here’s what I observed. My framework is a Functional Behavior Analysis—basically that every student’s behavior serves some function. If you look at the reason a student may be acting out, it’s usually to get something or escape something. The way you figure out the function is to observe the sequence of events—the Antecedent (what happens before), the Behavior (what the student does) and the Consequence (what happens? What does the student get or get out of?). It’s often called the A-B-C model among school psychologists.

1) Antecedent: Jonah asks the teacher for help.
Behavior: Teacher tells him to be quiet.
Consequence: Jonah continues to talk by requesting help two more times in a less polite fashion (gets teacher attention)

2) A: Teacher comes over to help Jonah
B: Accuses teacher of farting
C: Class laughs (gets peer attention) and he gets a time out (escapes work)

3) A: Teacher gives command to take cap off and he will get it at the end of the day
B: Jonah argues, gives hat to teacher, then makes another comment
C: Teacher ignores (still escaping work)

4) A: Jonah sneezes loudly
B: Teacher yells, “Jonah, Please!” and he continues to argue with her
C: Class laughs (gets peer attention, escapes work)

Okay, so one hypothesis is that Jonah doesn’t know how to do the work and is being disruptive to get out of doing the work and/or avoid looking dumb (‘Tis better to look bad than dumb, basically).

The other thing I notice is the desire for peer attention. His misbehavior and subsequent time out actually rewarded him by him gaining further peer attention. Actually, in a later episode, Jonah states to the “camera crew” that when he acts up, it’s providing a service to his classmates—“That’s not disruptive, that’s entertainment!”

So what did work and what can make the teacher-student interaction better? Research on oppositional and defiant behavior provides the following suggestions:

1) Respond to requests for help or redirect him to ask his classmate. One teacher I work with has an “Ask 3 before you ask me” rule to build independence. Responding to the request may not be enough, but it would at least prevent some of the problem.

2) Jonah’s noncompliant behavior may be related to wanting to “save face” when he finds tasks too difficult. Have a private conversation about the task difficulty level and encourage him to seek help when he is struggling, rather than making off-task remarks.

3) Ignore minor infractions. It’s the “Ye Olde Pick Your Battles” concept. This worked when Jonah grabbed his classmates’ heads and she ignored it. He stopped doing it. This one is tricky because as teachers have told me, it is difficult to ignore such rudeness. But figure out which things are non-negotiable and which things can slide. It will make things easier in the long run.

4) Avoid staying in the interaction too long. It is tempting to try and reason or plead with a student who is being oppositional, but as you can see, you will not win. You can’t reason with an oppositional kid, believe me, I’ve tried. You can say the sky is blue and s/he will disagree. This teacher especially wasn’t going to win this battle having the interaction in front of peers. He likes that. Have a private discussion. Reflect back his complaint and tell him what you expect him to do. Be brief and direct. Instead of “shoosh!” she may have tried “Jonah, I see you need some help getting started. Write the topic sentence and I’ll be back to check in on how it’s going in 5 minutes.”

5) If that doesn’t work, try the “Houdini” technique: Deliver the command and walk away. Model calmness. Use a business-like tone with an oppositional student (vs. sarcastic or angry). State what you expect him to do and walk away. Give a moment for the student to comply, too. This worked for the teacher when she asked him to give her the hat and he would get it back at the end of the day. Then she took the hat and walked away, ignoring the other hat comment.

6) If that command doesn’t work, avoid the power struggles by providing the directive again with fixed choices and/or predetermined consequences. This must be brief and direct and not in a threatening manner. “Jonah, I expect you to start your work now. When you finish, you can have some free time. If you choose to talk with your friends or make comments, then (predetermined consequence).

The importance of the predetermined consequence is that it is agree upon before the interaction so it is not a public threat (e.g. “If you don’t start your work, I’m going to call your mom!”). The problem with this is the student usually needs to save face at this point and may say, “fine, do it!” and then there you are in class with your idle threat you can’t follow through on.

If the consequence is predetermined, it’s just a follow through of the agreement. For some reason, students are more accepting of “it’s the rule/agreement” because it feels less like a personal attack (It’s not me, it’s the rule!). Some example predetermined consequences I’ve seen are: negative progress report, detention, classroom service, calls to parent, etc. She may have tried: “Remember our agreement that if you talked with friends in class instead of working, we would call your mom? I’d like to see a positive report instead. It's your choice."

7) Channel Jonah’s energy for good, not evil. Do more group work so he can get what he needs (peer attention) in an appropriate way. I’ve also seen teachers do the “fake task” when they see an antecedent that usually creates a power struggle and they intervene early in the chain of behavio. For example, a bouncy kid with ADHD may be asked to deliver a note/stapler/whatever to the secretary to get some of the energy out. Jonah’s a tricky one, because he may not enjoy positive adult attention, but it’s worth a try to get him in a helping role.

As I type, I am again struck by how difficult of a job teaching is, especially when you have a Jonah in your class. It is my hope that some of these strategies can be experimented with in your particular situation. And teachers…you all get a Purple Heart of Courage for showing up every day to work!

Thursday, 25 October 2007

eLearning Examples

I just saw Cathy Moore's great post - Elearning samples. She points to quite a few

Where was this when we were doing the Big Question - What are the examples of eLearning?

Which gave us links to the following:


It would be great to see more of these emerging. If you know of other examples, please drop me a note.

Oh and one of her comments mentioned: Build a sod house.

Observations

One of the jobs of a school psychologist is to go into the classroom and observe students who are having difficulties. It is one of my favorite parts of my job. Working with a student one-on-one is a whole different world than seeing the kid in action in class.

I have apparently had an affinity for observation since long before I became a school psychologist. Last summer, I went home for a visit and my parents dragged out boxes of my papers from elementary through high school. My folks were moving and wanted me to condense my childhood to one box. (Fair enough—I don’t need my high school essay on The Great Gatsby anymore). I came across a small blue notebook from 4th grade that made me laugh. It was like a little detective’s notebook filled with the times and actions of my classmates:

10:42: Mary goes to snack table. Takes more than her porshun! [sic]
10:44: Nick tries to sit next to Mary at snack table. She says the seat is taken.
10:45: Nick tells on Mary.
11:28: Michaela tries to be friends with Erin but Erin is best friends with Desiree
1:15: Back from P.E. Nick was being a sweat hog

Of course, since 4th grade, I have developed some modicum of professionalism in my write-ups of my observations—I try to remain objective and state just the facts of what transpired. And “sweat hog” is no longer in my vocabulary, thank god. But sometimes I still feel like a detective in my job, trying to piece together the constellation of information from many different people’s perspectives.

Observations are an essential "clue" in the detective/psychologist's assessment. I have been in many classrooms and seen many illuminating things. One kid who was an absolute joy to work with turned into an argumentative bully in P.E., another kid who was painted as the "wolf" aggressor by everyone was actually more of a "sheep" in class, getting picked on relentlessly. Turns out the aggressive behavior was the reaction to the bullying; He wasn't the instigator after all.

I have seen a lot of classrooms over the years, but I have never seen anything like what is secretly taped from kids’ cell phones and put on YouTube. It’s really quite shocking. There are a number of angry teacher moments captured on film that make me cringe. I cringe for the students experiencing the angry teacher and I cringe for the teacher that has to cope with months and months of students acting up in their classes. And we wonder why there’s a teacher shortage. But how does it get to this point? How can a teacher-student relationship go so awry to warrant yelling at a student in front of the class? And what can be done before it gets to this point?

I will search YouTube and find a good clip we can analyze together. Stay tuned. And fellow colleagues, don’t worry about me observing and documenting your snack-taking behavior in the teacher's lounge. I’m really not watching anymore, I promise. Unless you go for the last piece of cake. Then it’s on.

LMS RFP

Again - I would really welcome:
Continuing on from my earlier posts:
From several comments and from looking at my list of issues, I realize that writing a good LMS RFP is challenging and it's easy to make lots of mistakes.

LMS RFP Resources

John Theis wrote a dissertation on the contents of 25 RFPs submitted to an LMS vendor. His dissertation contains some interesting information. The best stuff is found on pages 36-42, 54, and 56-75, but don’t miss John’s Dedication. I normally skim by that sort of thing, but his caught my eye and it brought a tear.

Included in John's dissertation are sample outline elements from different RFPs. Definitely worth seeing those.

Karl Kapp was nice enough to point me to a series of articles he's done on the subject and a set of templates for the selection process including a template for the RFP:

Selecting an E-learning Solution, Part 1: Who Should be on Your E-Learning Selection Committee?

Selecting an E-learning Solution, Part 2: Avoiding Common RFP Mistakes

Selecting an E-learning Solution, Part 3: Ten Rules for a Smooth, Efficient E-Learning RFP Process

Selecting an E-learning Solution, Part 4: Inviting the Vendor To Present

And finally LMS Selection Templates.

Another good resource is: Learning Management Systems (LMS) A Review. This paper present ssome important criteria to evaluate and consider when purchasing a LMS. It also points out some of the purchasing mistakes that are common in that process.

Probably the best thing to do is simply to search on Google using a few tricks. For example:

(LMS OR "Learning Management System") AND
("Request for Proposal" OR RFP OR "Request for Quotation" OR RFQ) AND
(filetype:PDF OR filetype:DOC OR filetype:RTF)

will get you an interesting list.

In fact, I'm pretty sure that some of these are not supposed to be found!

You can also add "template" to the search to find a few more good results.

Good and Bad LMS RFP Requirements

When you search around for LMS RFP examples, you'll find quite a variation and it's worth reviewing a few different RFPs to determine what elements you want in your RFP. But, what I see as the most common problem in LMS RFP documents are the requirements.

Generic Requirements

Rule #1 - Don't write generic requirements!

Many of the examples show requirements that are written that are hopelessly generic. For example, I found an RFP example that had a long list of requirements such as:
  • Ability to create a training plan for individuals
  • Ability to create a training plan for a group
What do you mean by a training plan? It means something different to most organizations and LMS vendors. Most vendors will simply tell you "yes" to these kinds of generic requirements. And if they can do it for an individual, they can do it for a group – of course, you might have a hard time in a particular LMS getting your kind of groups to have a common training plan. The list in this LMS RFP went on and on at this level. It looked like the RFP requirements were copied straight from some generic list.

Another example has a requirement:

  • Supports a variety of learning formats

with a Yes/No response. The answer is "yes" unless the vendor is completely off their game. All LMS products support a variety of learning formats. At least clarify what you mean by a learning format. Are you talking different file formats or do you mean classroom vs. virtual classroom vs. asynchronous. And if that's what you mean, then list out the formats and what you mean by supporting the format.

The bottom line here is that there is only one case where a general / generic requirement is acceptable. That case is when it's a well known, well defined function and you DON'T CARE HOW IT'S DONE. In other words, any solution is acceptable. Otherwise, it's a waste of everyone's time to have a generic requirement when you really want something more specific than that.

RFP Death March Requirements

Another common mistake in RFP requirements are writing requirements that are well intended but make the vendor want to shoot themselves. Often they start with the word "describe" or "how do you" ... It's not always wrong to use these, but make sure that you really want the vendor to go to that much trouble. Or is it that you are trying to avoid having to write a more specific requirement?

For example in Learning Management Systems (LMS) A Review, one of the example requirements is:

  • Describe capabilities for managing course capacity and waitlists issues.

Most of the LMS vendors have the ability to define a course capacity and then put people on waitlists. The specific handling after that is often configurable, possibly at different levels of granularity. There’s notifications. A whole bunch flows off of this. As a vendor, do I guess at what’s important to the prospect? Hopefully, I can find a bunch of marketing text to copy in, but it’s going to be hard to write a response that will help the prospect.

Now, it could be that you mean this as a general requirement. In other words, you generally need capacity and waitlists, and you don't care how that is handled by the LMS. If that's the case, then change the wording to eliminate the need to "describe."

However, I would put money on the fact that you DO care and thus you should be writing requirements that are more specific. Do you require notifications when someone a spot frees up? Do you need that notification to go to the employee, the manager, an adminstrator? Do you need specific rules about timing? How does this affect compliance requirements in your organization? Chances are you have a few specific requirements that you really would want to discover by spending the time to write a better RFP requirement.

Another example from a different source:

  • Please describe how the application displays course information to the users.

Duh, it lists them and then it shows the course information. Is there something that your company needs that’s not standard?

Another example I ran into:
  • Describe administrative interface and usability.
Pretend you are the vendor. You have 30-50 administrative screens. You either will want to kill yourself or the customer.

Vague Requirements

Putting in a requirement that is vague is asking for problems later in the selection process. For example, one requirement I found:
  • Can customized course catalogs be defined and displayed to different sets of users?

Most systems will allow a user to see a different catalog based on job role, organization, etc. If those are the criteria, then say so. Otherwise, what is meant by “customized catalog.” Without additional detail, you are enticing the vendor to say "yes" to something that may or may not have.

Opinion Requirements

Another common mistake is to put in requirements that ask for an opinion. By far the most common is "easy to use" but you see these quite often. John Theis' dissertation (which looked at 25 RFPs) had a couple examples of requirements that help illustrate:

  • We require a solution that is personalized to the user, possesses a clean and easy-to-use interface, is easy to navigate, provides the ability to search for and find information, is menu driven and is intuitive.
  • Have feature rich and flexible administration “back-end control panel”

Cmon - "easy to navigate," "intuitive," "feature rich," "flexible." As a vendor, you had better believe that you are all of these things.

You will need to formulate your own opinions about "easy to use" and "intuitive." This is going to come from demos and testing, not from an RFP response. "Feature rich" and "flexible" are probably a cop-out from writing more explicit requirements.

Good Requirements

My preferred approach is to write requirements that are based on differentiating use cases. These are the things that make this organization's needs somewhat special. You can ask a bunch of generic requirements around functionality that falls outside of this, but you really focus the RFP on the items that you believe will differentiate the products.

The requirements will be very specific items that you are looking for:
  • Does your LMS work with WebEx as a virtual classroom tool to?
    • allow administrators to create virtual classroom sessions at a particular day/time that map onto a class in the LMS?
    • allow entry of the date and time is done on one screen by the administrator?
    • provide a link to the learner in an email notification that allows them to launch into the virtual classroom session?
    • track attendance at the virtual classroom session into the LMS?
  • Does your LMS allow us to associate pre-work with both instructor-led training and virtual classroom training?
    • allow pre-work to include SCORM courses?
These are very specific requirements. A few of these requirements were not "critical" requirements, but were nice to have. Generally we don't expose what are critical vs. important vs. nice-to-have within the RFP. There is still a lot left open in terms of how the LMS will allow you to accomplish each of these. During demonstrations and hands-on we would determine how well these things work in practice.

Also, I like to use an RFP where the columns are:
  • Requirement
  • Meets (Yes, No, Partial)
  • Explanation (Optional)
The expectation is that the vendor will write in Yes to those they meet. No to those they clearly don't meet. And they will explain what they do or don't do for those that are partially met.

Additional Thoughts

Karl Kapp's articles point to some good thoughts on writing RFPs that I've not touched on above:

  • Poorly Written - RFPs are notorious for being poorly written. Remember a Request for Proposal is a representation of your company. Take the time to do some proofreading before sending it to e-learning vendors.
  • Providing Too Little Detail - Vendors cannot help you to solve your e-learning problem if they know nothing about your organization, nothing about your technological infrastructure, etc. Give them some background.

  • Poorly Scoped - Karl talks about writing an RFP in which your needs are larger or smaller than what you are suggesting in the RFP. Most often this is because you actually don't know your needs. See my common mistakes.
  • Make sure the vendor knows the business needs / rationale / context

LMS Selection Presentation Reformulated

Continuing on from my earlier posts:
Great suggestions from everyone.

I've decided that Wendy's suggestion of asking for participation along the way is a great way to go. As I walk through different parts of the selection process, I'll ask for things that members of the audience have encountered for those who have gone through it. Thanks Wendy.

My outline has evolved a bit.

Topic #1 - LMS Dissatisfaction - Don't Do It!
Topic #2 - LMS Selection Process

I'm going to break the process into a few bigger buckets:

  1. Start Up
    • Form a core selection team and define stakeholders
    • Define business and learning strategy
    • Agree to process with key stakeholders
  2. Evaluation
    • Capture requirements and differentiating use cases
      • Questions
      • Interviews / expectation setting
      • Drill down on non-standard items
    • Conduct initial research, select initial vendors, make contact
      • sometimes done via RFI
      • eLearningGuild, Brandon Hall or Bersin might help
  3. Implementation
    • Installation and configuration kick-off
    • Define models, etc.
    • Configuration, customization
    • Testing
    • Pilot
    • Communication
  4. Life with an LMS
Focus will be on:
Topic #2 - Common Mistakes
  1. Missing key team members such as IT
  2. Not handling politics
    • Favorites
    • Incumbents
    • Power plays
  3. Not having an overall strategy defined
  4. Not having agreement on selection process
  5. Not defining communication path during selection process.
  6. Over stating how much LMS you need and/or missing the opportunity for a Starter LMS.
  7. Underestimating people required to operate an LMS.
  8. No clear governance after selection.
  9. Confusing content authoring selection and LMS selection.
  10. Not defining differentiating use cases.
  11. Not working with different constituents to capture differentiating use cases
  12. Missing the opportunity to set expectations while gathering requirements.
  13. Confusing an RFI and an RFP.
  14. Confusing critical requirements as compared to requirements that are somewhere on the important - nice-to-have scale.
  15. Putting the wrong requirements in an RFP.
    • Making an RFP that will make vendors hate you.
    • Writing an RFP that won't help you differentiate between vendors.
  16. Missing a few critical questions in the RFP or selection process.
  17. Tripping on contract negotiations.
  18. Not understanding the implication of LMS models to your business.
  19. Customization
This list is too long. I'm going to have to focus on only a few. Hopefully people in the audience will hit a bunch of these topics. I may try to focus it down to a Top 10 and count down to a Number 1 that is oriented around RFPs hence to move into my last topic. (Yes, I'm willing to cheat on what I see as the #1 mistake to make things flow.)

Topic #5 - Writing a Good RFP

The RFP strikes me as being a big enough topic on it's own. I'm going to focus on that alone in my next post. Which I need to do right away. The dang conference is coming up fast.

Okay, I have the high level outline and an idea (thanks to Wendy) of the style I'm going to use.

I don't think I'm going to have time for Implementation or Life with an LMS.

Wednesday, 24 October 2007

Enterprise 2.0 Has Arrived

Great article by Dion Hinchcliffe - The State of Enterprise 2.0.
Increasing evidence abounds that Enterprise 2.0 adoption has begun in earnest with a typical example being Wells Fargo taking the plunge, having rolled out Enterprise 2.0 platforms to 160,000 workers. It has become clear that we’re moving out of the early pioneer phase to a broader acceptance phase. From the production side, a brand new analysis indicates that the business social software market will be nearly $1 billion strong this year and over $3.3 billion by 2011. In these and other ways, such as the growing collection of success stories, Enterprise 2.0 has arrived.
Adoption is still sporadic, but it is certainly happening. I would suggest that there's a big difference between tools being purchased and adoption happening in big, meaningful ways. Keep in mind Knowledge Management (KM).

Dion then talks about some Lessons Learned:
  • Lesson #1: Enterprise 2.0 is going to happen in your organization with you or without you.
  • Lesson #2: Effective Enterprise 2.0 seems to involve more than just blogs and wikis.
  • Lesson #3: Enterprise 2.0 is more a state of mind than a product you can purchase.

  • Lesson #4: Most businesses still need to educate their workers on the techniques and best practices of Enterprise 2.0 and social media.
  • Lesson #5: The benefits of Enterprise 2.0 can be dramatic, but only builds steadily over time.
  • Lesson #6: Enterprise 2.0 doesn’t seem to put older IT systems out of business.
  • Lesson #7: Your organization will begin to change in new ways because of Enterprise 2.0. Be ready.
Great stuff. Lesson #4 is something that I've been wondering about for quite a while. And my firm conclusion is that there are many new methods, skills, tools, knowledge around how to accomplish our work and learning (see Needed Skills for New Media).

There's an important role for training organizations to help understand and develop these skills in the enterprise.

Tuesday, 23 October 2007

T+D Webcast - Social Networking and Learning

Tony O'Driscoll, Paula Ketter and I did a webcast for T+D - ASTD's publication today. Unfortunately, we ran into a few technical issues. For example, I was trying to demonstrate elements of my blog and found out that folks were not seeing anything. Ouch. Rookie move not to ask if everyone was seeing it. There was also the issue that we had a heck of a time getting into the system in the first place. I'm sure lots of other people experienced it - and weren't able to get in.

All that said, it was fun to participate in the session. Tony O'Driscoll did a comparison of the evolution of Web 1.0 to 2.0 and Learning 1.0 to Learning 2.0. It's a bit different than my comparison of eLearning 1.0 to 1.3 to 2.0. But similar in nature. It's a question of what happens as production moves from being owned by the training organization to one where SMEs and learners are more responsible.

Tony's examples were brief, but interesting:
  • Wikis
    • Product updates/news
    • Project management
  • Podcasts
    • Communications
    • Sales / Field Force
  • Collective Intelligence
    • Predictive markets
  • Social Networking
    • New Hires
    • Communities of Practice
One of the questions we got was: How do you start as a Learning Professional?
  • Start with yourself and your work group
  • Adopt tools that are free and password protected
  • Build champions and skills to grow in your organization
I couldn't keep up with the other questions, but there was actually some good stuff that we discussed.

The associated links:
You might also want to look at my eLearning 2.0 Presentation post.

LMS Selection Team and Stakeholders

As I discussed in my post LMS Selection Process, I’m preparing for my part of an upcoming session at DevLearn on LMS Selection as part of The Learning Management Systems Symposium. I'm preparing this by posting my thoughts and notes prior to creating my slides with the hope of getting feedback.

Thanks to everyone who has already contributed. There was some great feedback on my last post - see the comments. I hope you'll continue to give me feedback as I go.

In my previous post I presented my high-level LMS Selection Process. My general impression from the feedback is that there wasn't much debate around that process, but there was quite a bit of input and clarification on the details. So, this post simply captures thoughts around who should be involved in the LMS Selection.

Great article by Karl Kapp - Selecting an E-learning Solution, Part 1: Who Should be on Your E-Learning Selection Committee? He includes:
  • Training/Learning Manager or Director (Chief Learning Officer)
  • Information Technology
  • Procurement
  • Learners
  • Line Supervisors
  • Business Unit Leaders
  • Sales and Marketing
  • Customer Service
  • Safety/Compliance
This is a great starting point. A few quick thoughts / changes:
  • I'll change Procurement to Legal / Procurement
  • I would group Learners and Line Supervisors under an umbrella of "end users".
  • I would similarly group each of the functional areas and business units.
  • Add future LMS administrators
  • Add HR / OD
  • Add Help Desk / Internal Support
There's also an issue of identifying who is part of the different levels of involvement in the process. I normally define:
  • Core LMS Selection Team
  • Full LMS Selection Team
  • Stakeholders
The Core LMS Selection Team does the day-to-day work on the project. This is often a relatively small group of 4-5 people and should definitely include the primary manager responsible for the process and a future LMS administrator.

The Full LMS Selection Team includes the list above, but they come together during key points in the process, e.g., agreeing to the process, providing requirements, viewing demos, participating in hands-on, etc.

Stakeholders include people who are not directly involved in the decision making process, but who will be affected by the outcome. Senior management jumps to mind on this. So does whomever owns the HRIS system. They may not be directly involved in selection, but they will get involved in the process.

So my list might look more like:
  • Core Team
    • Primary manager
    • Future administrator
    • Project manager
  • Selection Team
    • Core Team
    • IT
    • Procurement / Legal
    • Business Unit Representatives
    • Functional Area Representatives
    • Learner and Line Manager Representatives
    • Additional Future LMS administrators
    • HR / OD
    • Help Desk / Internal Support
  • Stakeholders
    • Senior Management
    • HRIS owner
As I'm writing this, I'm pretty sure I'm not going to present it. Rather, I'm going to show it and then discuss things that often go wrong:
  • Politics
  • Communications
  • Process
  • Not involving IT
  • Missing stakeholders
So, I'm thinking my presentation so far is:
  • Process - flash it up, but won't spend time
  • Selection team - flash it up, but won't spend timeI
    • Issues - will spend time here
Hopefully this pattern can continue during the presentation.

I'm curious if this seems like it would be helpful or boring. I'm still a bit torn.

Saturday, 20 October 2007

Danger! Fun Ahead!

My friend emailed me this article from the SF Chronicle yesterday about the “Wussification of America’s Children.” It basically says that we worry too much about our children. It contends that the overprotection of children can even hurt their development.

This is a phenomenon that I have seen in popular media, but not necessarily in the research. I have heard the term “Helicopter Parenting” to describe this idea—the parent hovers over the child and at the first sign of distress swoops in to rescue him or her. Then the child does not learn how to cope for him or herself and gets the message that the world is a dangerous place.

I have worked with a few parents over the years that have some of these characteristics. One parent I worked with (and her advocate and lawyer) demanded that the school write in the IEP (Special Education Contract) that the child’s classroom be kept at 68 degrees. This is the same student who refused to come see me for testing without her mother (she was in 10th grade, by the way). Common sense dictates that this girl would not be working toward any sort of independence. But what does the research say?

The developmental psychology research on parenting is as big as the Internet search for “parenting” (25,700,000). It’s expansive, conflicting, and confusing. One article will say that parents need to do X and then the next will say that X is the worst possible thing to do, you must do Y. One of the longest-standing theories of parenting and related outcomes is the work by Diana Baumrind (of my alma matter, UC Berkeley).* Baumrind proposed back in 1966 three parenting styles that to date, still permeate the research on parenting: the Authoritarian Parenting Style (low warmth, high control), Permissive Parenting Style (high warmth, low control) and Authoritative Parenting Style (high warmth, moderate control).

Study after study uses these parenting styles to predict any number of outcomes, but mostly academic success and social skills. The Authoritative Parenting Style usually comes out on top. I wonder where Helicopter Parenting fits in to this dynamic. It’s sort of room temperature—not exactly warm, not exactly cold. The control is variable too—it can be permissive, authoritarian or authoritative, depending on the parent.

What I do know is that life is not room temperature. We need to teach our children the coping skills to “weather the storm” of life. I grew up in Colorado where in one day it would be 90 degrees and the next day it would snow. If my parents had only let me experience the 68-degree days, I would have missed out on swimming at the pool, early entrepreneurship with lemonade stands, making snowmen with my sister (and snow-women, we were egalitarian), and skiing in the mountains with hot cocoa breaks to warm our frozen noses. And those are some of my fondest childhood memories.

*Sidebar: Diana Baumrind worked out at my gym and she is unstoppable in Spin class. There’s a metaphor in there somewhere but I haven’t had my coffee yet.

Friday, 19 October 2007

The Uglist Girl in School

When I was a junior in high school, I would pick up my friend along the way to school so we could ride together. She was not a morning person (still isn’t, btw). One morning, I got there a little early so instead of my usual honk, I came in for a minute. She looked the opposite of ready. She was near tears because she had a cowlick (I didn’t know what this was, but apparently it’s portion of your hair that always goes the wrong way) and it wasn’t cooperating. She exclaimed that she couldn’t go with me because she was “The Ugliest Girl in School.” And as a good best friend, I believe we scrambled around for a baseball hat or some gel or something because I totally understood. I had had a similar encounter the week before in which she had dyed my hair “Ash Blonde” and it turned out gray.* I was certain that this event would prohibit all boys from asking me to prom and ran to the store across town in a disguise to get some new hair dye right away.

We both thought the whole school was going to take note of our hair. Reality is, our classmates were probably thinking of their own new zit or how they were under or over developed, not our hair.**

What is it about adolescence that creates such sensitivity to what others think? Why did we feel like we were under a microscope by our peers? How did our peers influence our self-perceptions?

Research on Peer Influence

The debate about if peers or parents are more influential is still ongoing. There tends to be less polarity in the field, with the general consensus that it’s both. The question is how peers and parents are influential and how they interact.

It is true that adolescence is a time when peers play an increasingly important role in the lives of youth. This role can be positive or negative, but developing friendships is an important process that helps adolescents construct their identities. Identities are basically the stories adolescents tell about themselves, and sometimes come with identifying labels, such as “jock,” “troublemaker,” “nerd,” “popular,” or “ugliest girl in school.”


But research also suggests that parent relationships are not necessarily undermined by peer relationships. And while it seems that teens are influenced by their peers, parents clearly continue to be influential in their lives. Friends come and go, but parents are there to stay. Also, teens tend to choose those who are similar to them in values, so if a parent and teen have a healthy relationship, then they will likely seek out healthy relationships with peers.

The problem with the notion of peer pressure/affiliation with negative peers “causing” misbehavior is the relationship is correlational, and not necessarily causal. A recent meta-analysis of the literature suggests that peer influence on drug use is overestimated. Basically, if your kid already values doing drugs, they will select similar drug-using friends, and therein lies the correlation. Why that may be valued is complex. I know of not one behavior that is directly caused by only one event or person. Child development is far too complex for that. Certainly no one was pressuring us to wear our hair in certain ways. This is why the term “peer pressure" is misleading. It can be misleading for a number of reasons.

1) We never referred to other students as “peers” so the term “peer pressure” was somewhat lost on us. To this day, I have never heard a child or adolescent say the word “peer” in reference to a classmate.

2) The term “peer pressure” evoked an image of random unknown classmate emerging from the dark shadows of the locker room to sell us drugs. That never happened.

3) We in fact mocked lessons on how to combat “peer pressure” by well meaning adults. My mom, bless her heart, bought this book for parenting teens when I was in high school called “Get out of my life! But first can you drive me and Cheryl to the mall?” or “Teen Talk!” or something like that. My best friend and I got our hands on it and have never laughed so hard. This is a sample script the parent was supposed to teach the teen to resist peer pressure for drugs.

Pressuring Teen: Hey man, want to smoke some grass?
Pressured Teen: I don’t smoke grass, I mow it!
Pressuring Teen: Ok, man!

So. Off. The. Mark. On so many levels. It just doesn’t happen that way.

As long as there are teenagers, there will be a debate about how influential peers and parents are during this developmental period. When we figure this out, we may also be able to answer important questions about fashion, hair, and other adolescent fads. I, for one, am dying to know how an entire generation of my peers convinced each other that tight jeans, leg warmers, fluorescent tops, and giant bangs were a good fashion idea. We know the parents weren’t responsible for that.



* *Shudder* I still get chills remembering looking in the mirror and seeing my 16 year old self look exactly like my grandmother.

**Maybe. I still contend, to this day, that it would have been obvious if I showed up with gray hair. My friend, to this day, says it wasn’t that bad.

Thursday, 18 October 2007

Caught in the Middle: Part III

Social Factors

The following is a confabulated* transcript based on a conversation with one of my 6th grade middle school students. He was referred to me for special education testing because he was suspected of having Attention Deficit Hyperactivity Disorder. He reported hating his English teacher and was constantly being kicked out of class for getting out of his seat without permission and talking out. None of the other data supported a diagnosis of ADHD. He was attentive in his other classes and previous report cards from his cumulative folder never mentioned inattention or hyperactivity. But there was still the issue that he was disruptive in class and hated school.

Dr. Bell: Let’s play a game called ‘I start a sentence and you finish it’
Middle School Boy: Ok.
DB: I like to…
MSB: Play video games.
DB: My favorite part of school is…
MSB: Recess.
DB: If I were president, I would…
MSB: Cancel school forever!

(Interjection: Great, I have uncovered that he doesn’t like school. Not exactly new info)

DB: Teachers are…
MSB: Mean. My teacher is always mad.
DB: What makes her mad?
MSB: I get out of my seat to sharpen my pencil. I was allowed to in 5th grade!
DB: What else makes her mad?
MSB: When I ask my friends what they got for answers.
DB: What does she say?
MSB: That I’m cheating! But we always worked in groups in my elementary school so I thought it was ok.

This confabulated* transcript highlights what studies have shown about the difficulties that students have in making the transition to middle school. It has been shown that student motivation and attitudes toward school tend to decline during this transition. The theory goes that there is a poor fit between the developmental needs of preadolescents and the social environment of middle school (Eccles et al.).

Stage-environment Fit

Essentially, the theory goes, middle school aged students are beginning to want more autonomy, peer groups are becoming more important, and many middle schools are not set up to support these developmental needs. Beginning in middle school, there is more academic tracking, increasing competition, and fewer opportunities for decision-making. This is what was going on for the kid I was working with. His developmental need for independent learning and collaborating with his classmates was mismatched with the teacher’s style. Now there is value in him learning how to adapt to a mismatched teacher, so we had a consultation meeting and the two began to understand each other better.

Also remember that our friends with the developing prefrontal cortexes now have several classes and teachers and new procedures for each. We should not expect our middle school children to wake up for 6th grade with all the knowledge on how to navigate such a new environment and successfully organize all their materials for each class. There are some students who do have these skills already, but don’t assume. We didn’t expect our 4 year olds to wake up and know how to tie their shoes—we had to teach them.

Some tips for middle school parents (and educators) on how to help your middle school student if they are having difficulties adjusting can be found at a great website by the National Middle School Association.

Peers

I would be remiss if I didn’t discuss peers in a post about the social factors that contribute to adolescence. Unfortunately, this would take 6, maybe 7,000 hours and I have to go to work. Stay tuned for a snippet about peers for tomorrow’s post (It will be post 1 of a 7,000 part series). I will leave you with a teaser:

Ugliest Girl in School.


*I have always wanted to use the word confabulated. Thank you for the opportunity.

LMS Selection Process

I’m preparing for my part of an upcoming session at DevLearn on LMS selection as part of The Learning Management Systems Symposium. I'm going to prepare for this in a slightly different way. I'm going to create notes in my blog as a series of posts as I think about what I'll present and then I'll turn them into slides. Hopefully, this will:

  1. Allow me to get input from readers and that means you - yes YOU - I see you reading this and thinking - he doesn't mean me - no I really mean YOU. Help me make this presentation better. Please. Especially what am I missing, what will be useful for an audience of corporate learning folks who are contemplating LMS selection, what won't be useful (and I should delete). I truly need to get input or this could be a boring session - and I don't like boring sessions - see my reservations about the presentation below.

  2. Create an interesting resource for participants and readers - yes that's you as well.
So, first, what am I talking about:

How to Conduct a Successful

Learning Management Systems (LMS) Selection Process



LMS Selection Background:

I'm coming from a background of personally working and coaching on a bunch of LMS selection, installation and configuration projects and being heavily involved in the design and development of several custom LMS implementations. My goal in the presentation and in these posts is to provide a basic process and try to capture specific areas that have been learned the hard way through these varied experiences to help define what makes a selection process successful. In some ways, I'm trying to help people achieve better LMS Satisfaction.

My selection experience primarily is in corporate environments, but I’ve also been involved in non-profits, foundations and to a lesser extent education and government. My custom implementation experience is generally with specialized content providers. Most of the time, I’m working with larger organizations who have 2,000+ learners and several different constiuents involved. However, most of this applies fairly well across other kinds of organizations.

Reservations:

I'm somewhat concerned that there's no good way to capture this stuff in a presentation that will be meaningful and useful. Most people only go through a few selection processes in their career. And not every issue is going to come up on every selection process. Thus, can I really identify stuff that will be useful?

Also, I don't want this to be a presentation form of eLearningGuild LMS Selection Tips. This has a lot of lessons learned, but it's daunting and it more or less prompts you about things you need to look out for, but not necessarily what to do. So, if they have 500 tips or something like that and I'm giving 20 tips, how is my presentation going to be useful?

Hence my reservations.

The LMS Selection Process



I'm not sure how interesting it will be to walk through the LMS Selection Process. In my experience, most of the definitions of the process are fairly similar. If you go out and search you will quickly find resources like:

The processes described there are similar to the process that I generally have used. And the process differs slightly based on the context. My rough draft of my LMS Selection Process is:

  1. Form a core selection team and define stakeholders
  2. Define business and learning strategy
  3. Agree to process with key stakeholders
  4. Capture requirements and differentiating use cases
    • Questions
    • Interviews / expectation setting
    • Drill down on non-standard items
  5. Conduct initial research, select initial vendors, make contact
    • sometimes done via RFI
    • eLearningGuild, Brandon Hall or Bersin might help
  6. Prepare and send RFP (Request for Proposal Sample)
  7. Select finalists
  8. Demos
  9. Pilot or hands-on tests
  10. Negotiate
  11. Final selection
  12. Installation and configuration kick-off
  13. Define models, etc.
  14. Configuration, customization
  15. Testing
  16. Pilot
  17. Communication
I'm not sure how interesting it would be to step through each line item of the process. When I've sat in the audience as someone walks through their process steps - yawn.

The LMS Selection Process Issues



So, instead, I plan to focus on key differences in the process based on specific situations and places where I've seen things go wrong before. This will be somewhat similar to my LMS Selection Gotcha list. But I also plan to include specific items such as:
  • Some political issues especially playing favorites.
  • Common communication problems.
  • How much LMS do you really need? And the starter LMS.
  • Getting agreement on strategy and process.
  • Content authoring selection vs. LMS selection.
  • Defining differentiating use cases.
  • How to work with different constituents to capture differentiating use cases and how to use that as an opportunity to set expectations.
  • Difference between an RFI and an RFP. When do an RFI? Ways to down select without an RFI?
  • Making sure you understand a critical requirement as compared to a requirement that's somewhere on the important - nice-to-have scale.
  • What requirements to put in an RFP.
  • How to balance making an RFP response useful to you and not too hard for a vendor.
  • How much should you lead a vendor in the RFP requirments.
  • Examples of good and bad requirements.
  • A few critical questions that sometimes get missed.
  • Contract negotiations.
  • LMS fit is 50% models.
  • Customization
Does this seem like a good list? Am I missing issues? Which of these are not worth discussing?

This list seems like it will take me more than an hour to go through as it stands, so I'll probably shorten, but thought I should list out what I'm thinking right now.

I'll also make a list of resources as I find them. I've got quite a few on the process and various issues. I have a few example templates. I don't have good stuff on the fuzzy front-end, defining strategy, etc. Anything you think would be a good resource, feel free to send me or tag in del.icio.us with lmsselection.

Wednesday, 17 October 2007

Facebook Platform

Stephen Downes picked up my post on Facebook As a Learning Platform. He commented:
To be clear, I do not think that Facebook itself is really a learning environment. It's a large, centralized piece of software that is getting creaky with use (we've seen more outages and the PHP code is once again dumping itself into users' browsers). Its privacy policies are questionable and it is giving out user information to applications willy-nilly. But it is still important, because it reveals many of the features future learning environments (and personal environments in general) will need to have. Something like the social network operating system, maybe. These are nicely captured by this article as Tony Karrer pulls together a number of recent resources on the site to throw out some ideas.
Because Stephen and I come from such different environments, perspectives, etc., it's always an interesting data point when he and I are in complete agreement. I also feel like Facebook is a bit creaky and as Thomas Vanderwal's recent post Facebook for Business or LinkedIn Gets More Valuable points out, as you use Facebook more and have more friends, it seems to get harder to use. Linked in doesn't seem to suffer from that.

All of that said, Facebook is surprising me in terms of how well it works as a platform. As I mentioned in my other post, it effectively provides an operating environment that knows about:
  • You (your profile, interests, demographics)
  • Your friends
  • Your groups
Think of all of the different Web 2.0 applications that similarly try to figure this stuff out. Luis Suarez - How to Boost Your Social Capital with Facebook mentions MyBlogLog. Great example, Luis. Shouldn't MyBlogLog link directly to each person's Facebook account so I can have that profile information? Shouldn't the MyBlogLog community form a kind of group? If you think about MyBlogLog implemented on top of Facebook it becomes a better application because I'll know more people who are visiting my blog. And I can connect with them in better ways. In fact, MyBlogLog should get to it!

And as you run down different applications, you find that You, Friends and Groups are fairly common. In fact, LMS, Elgg, Flickr, del.icio.us, Wikis, Blogs, Discussion Groups, Amazon, hmmm, the list gets long quickly. Pretty much everything I would ever do that would associate me with other people. It's pretty much the same issue that's been discussed before in terms of currently having Too Many Social Networks?and Multiple Social Networks. However, in this case, I almost see it more form the opportunity side of things. There are some really interesting opportunities to treat Facebook like a uniting platform.

Tuesday, 16 October 2007

Caught in the Middle: Part II

Psychological Factors

Let’s get back to our middle school friends. One of the psychological factors that helps to explain middle school students is Identity Development.

Have any of you seen that scene in Zoolander in which Ben Stiller looks into a puddle, sees his reflection, and says “Who am I?” only to be splashed in the face by the puddle by an oncoming car? That’s basically what’s going on in early adolescence.

I am reminded of a situation that happened at one of my schools. A teacher came to me perplexed because one of his 8th grade students was acting up in class. He had taught him in 7th grade and he was a delightful student—did his homework, was respectful, helped him out after school with cleaning up the classroom—a model student. Now the student is in 8th grade and is defiant, rude, and hasn’t turned in a thing all year. He disrespects the teacher all the time, publicly. It had the flavor of a typical “Class Clown” situation. The teacher was fed up that day because the student told the class he thought that his teacher was the star of the movie, “The 40-Year Old Virgin.” Okay, that’s kind of funny, I admit (because it wasn’t directed at me!). But there is a time and place for being funny, and it’s not during a math lesson.

So what happened? How did Sweetie McStudent turn into Class Clown? Is there any hope for getting Sweetie McStudent back?

Let’s take this on using one of my favorite theorists for explaining adolescence. Erik Erikson would say you can get Sweetie back if he can resolve his “identity crisis.” Erikson’s theory of development basically says that there are certain “stages” and developmental tasks that people must go through in their life to have a healthy identity. They must accept and work through these conflicts in order to develop virtues, such as fidelity and competence.

The stage Erikson describes for adolescence is called “Identity vs. Role Confusion.” This means that adolescents are trying on different roles and seeing how they fit. This student had tried out the “Sweetie McStudent” role and now was going to try on “Class Clown” role for a bit and see what that gets him in life. Sweetie McStudent gets the respect of your teacher and probably parents, while Class Clown gets you the respect of your peers. It’s a trade-off, and perhaps he was confused about what type of adolescent he wanted to be. This role confusion and trying on of identities in adolescence is normal, according to Erikson.

Fortunately for you, I have the (partial) epilogue to this story because I was friends with the school psychologist at the student’s high school the next year. He made the freshman baseball team in 9th grade, which was a turnaround for him, because he needed good grades to be on the team. So he began integrating his identity by being both a Sweetie McStudent and a Sporty McSportsalot. Maybe one day he'll even integrate his Class Clown skills into his identity and he'll end up being a comedian too. The kid was funny.

Video Format Comparison - Flash Video Format - WMV Format - Quicktime - Real

I was recently asked what video format to use and particularly about the differences between the Flash Video Format (FLV) and Windows Media - WMV Format.

In The Rise of Flash Video - Tom Green tells us:
This is not to say QuickTime and Windows Media are dead technologies. They aren’t by a long shot, but when it comes to putting video on the web, the Flash Player has rapidly become the only game in town.
Why has this happened?

Market Penetration

The Flash player is installed on a higher percentage of end user computers than any other video format. Although not all end users have the latest version installed (so they may not support the latest Flash video codec), Flash still enjoys the best overall support. And as more consumer sites continue to move to the Flash video format, it's even more likely that your audience will have an appropriate player.

In some organizations, you have desktops that are guaranteed to have a particular player installed. So this may be less of an issue. Check with your IT department to find out what you have installed. Note: there are organizations that intentionally remove particular media players, even Flash.

Consistent Playback

The Flash video format works well across PCs, Macs, Linux, etc. Flash files are very consistent in their playback. They also handle variable connection speeds pretty well. It's nice to know that it will play well across varied platforms.

Theoretically, the other formats can work across different platforms, e.g., there's a Windows Media Player for Mac OS X and some ways to playback WMV Format on Linux. The reality is that the Flash video format will work much more consistently across different platforms.

Better "Streaming"

In general, the Flash video format is very good at playing as it streams down additional content. WMV Format, Quicktime and Real either require a streaming server to achieve the effect or do not do as good of a job. While they've improved, it still seams like these other technologies are behind in progressive download.

Advanced Features

The Flash video format provides some very nice features for overlays and interactivity.

Quality Debate

There is quite a bit of debate on the web about the quality of the resulting video and also about the relative bandwidth required for the video. Several sources say that the same quality flash video format movie will have a larger file size and require greater bandwidth. It's not clear how true this is. And it also changes as codecs emerge. For most eLearning applications, this has not been enough to differentiate the choices.

Protection

One of the specific questions I was asked was around caching and protection of the movie. Unfortunately, the Flash Video Format sent via progressive download end up in the user's cache and are unprotected. From Adobe:
Flash video content and MP3s delivered to Flash Player using a normal web server are delivered through progressive download. This content is cached on the end user's hard drive and can be easily accessed—and possibly stolen by the user. By contrast, audio, video, and data streamed to Flash clients using Flash Media Server are not cached on local client machines.
The only way around this is to use a Flash Media Server. Of course, the same is true of the other formats. Delivering a file via a standard HTTP request (without a streaming server) will leave the asset available.

Conclusion

The bottom line is that right now, unless I have a really good reason, my default choice is the Flash Video Format.

ROI and Metrics in eLearning

I'm working on an article around the use of ROI and metrics in eLearning. I did a quick search for resources and here's what I found. I thought it would be worth posting this list here.
  1. Kirkpatrick’s Level 3: Improving the Evaluation of E-Learning

    Level 3 evaluations measure whether the there was an actual transfer of learning to the actual work setting. This level of evaluation will increase the visibility of learning and development efforts, because successful implementation of Level 3 evaluation

  2. Internet Time Blog: ROI is toast. Use EVA instead.

    ROI is toast. Use EVA instead.

  3. Support - ROI Calculator

    Training & Support Return on Investment Calculator

  4. Investing in Learning: Consider Value, Not Just ROI

    ROI, or return on investment, is king in today’s business world. Touted routinely by managers and project leaders, ROI is used as a selling point in print advertisements and is featured regularly in news and business discussions because, for every purch

  5. Build the Business Case for Training and Measuring ROI - LTI Magazine

    A training program with objectives linked to business results and backed with a solid business case is less vulnerable to spending cuts. To ensure adequate funding and organization-wide commitment to your training program, you must be equally committed to

  6. Online Course Development: What Does It Cost?

    Does it cost less to design and develop online teaching and learning today than it did a few years ago? Are the categories of cost different today from the past and from what the costs might be in the future? The costs of developing online programs are si

  7. Determining Training Return-on-Investment (ROI) - Strategies to Succeed in Training: School for Champions

    Measurement of training ROI starts with defining the reasons and goals for the training, determining how much the training costs, and verifying the amount of return. Questions you may have include: * What is the reason for the training? * What i

  8. Assessing the ROI of training

    If people really are your greatest asset, isn't it time to look at your training programmes as investments in your organisation's human capital and not just as an expense? In this article, Clive Shepherd argues the case for return on investment (ROI) as a

  9. ROI from Workflow-Based E-Learning

    Business process management (BPM), workflow management, business activity monitoring (BAM), and workforce optimization software also are designed to reduce lag time. BPM and workflow technologies have been able to achieve significant gains in productivity

  10. Metrics

    Recently, functional managers have begun using eLearning to meet business objectives. Managers look beyond employees to customers, suppliers, and distribution channels -- everyone benefits from seeding eLearning throughout the value chain. This is where w

  11. Return on Investment in Training - Learnativity.com

    The problem is that nobody is quite sure what the appropriate metrics are for measuring ROI for learning. Is it student throughput or time to mastery? Is it dropout rates or full-time equivalents returned to the workforce? One thing is certain: many smart

  12. The Truth About e-Learning ROI

    There were four key questions that were going to be addressed: 1. What do we mean by ROI? 2. How important is it? 3. How do you calculate ROI? 4. What’s wrong with how it’s generally calculated?

  13. Proving 900 Percent ROI

    The ROI for e-learning internally at Cisco is 900 percent per course.

  14. Measuring the ROI of E-Learning

    E-learning can have an enormous financial impact on a business, but proving a return on investment can be tricky unless you know what to look for. There are hard and soft cost savings associated with e-learning. Hard numbers are the external factors, such

  15. E-learning ROI: How to Build Your Business Case - LTI Magazine

    Despite the challenges associated with measuring ROI, there are simple steps that companies can take to create a meaningful ROI in a faster and more cost-efficient way. Below, we'll explore how companies can conduct "pilot" e-learning projects by tapping

  16. Measure the Metrics - How to link e-learning to business strategy - LTI Magazine

    At this point, someone higher up in the organization will start asking about the return on investment (ROI) for the program and whether they're getting their money's worth. The way to demonstrate that is by doing Kirkpatrick Level 3 (measuring the extent

  17. ROI of E-Learning: Closing In

    When it comes to e-learning, computing ROI suddenly becomes a complicated procedure requiring thoughtful chinstroking, serious seminar time, and earnest input from consultants and vendors.

  18. A Fresh Look at ROI

    Different levels of management make different sorts of decisions, so it's appropriate that they use different measures of ROI.

  19. ROI for E-Learning

    People fail to recognize many non-cost related benefits of e-learning solutions, such as reach, consistent messaging, and flexibility. Despite those factors (and many others like them), proving a business case for e-learning still means being able to demonstrate value.

  20. eLearning Technology: Formalizing and Investing in Informal Learning
  21. eLearning Technology: State of Assessment by E-Learning Developers
Additional Articles Added April 28, 2008

· Cost Comparison: Instructor-Led Vs. E-Learning

· ROI and Metrics in eLearning : eLearning Technology

· e-Learning Centre by Learning Light - Costs, benefits and ROI of e-learning

· Tips to ensure that your investment in e-learning is effective.

· Return on Investment in Training - Learnativity.com

· ROI for E-Learning

· Online Course Development: What Does It Cost?

· ROI and Analytics

· Internet Time Blog: ROI is toast. Use EVA instead.

· Assessing the ROI of training

· eLearning Solutions for custom corporate training - Knowledge Anywhere

· Measure the Metrics - How to link e-learning to business strategy - LTI Magazine

· Calculating ROI

· A Fresh Look at ROI

· ROI of E-Learning: Closing In

· E-learning ROI: How to Build Your Business Case - LTI Magazine

· Proving 900 Percent ROI

· The Truth About e-Learning ROI

· Metrics

· ROI from Workflow-Based E-Learning

· Determining Training Return-on-Investment (ROI) - Strategies to Succeed in Training: School for Champions

· Build the Business Case for Training and Measuring ROI - LTI Magazine

· Investing in Learning: Consider Value, Not Just ROI

· Kirkpatrick's Level 3: Improving the Evaluation of E-Learning

· Measuring the ROI of E-Learning

· Increasing Prosperity through value networks

· elearnspace. everything elearning: Evaluating: ROI

· Learnometer: Dashboard measures of investment performance in learning...

· Learning Circuits - Analyze This!

· OUseful Info: Course Analytics - Prequel

· Course Analytics, Part 1 - Visitor Behaviour

· Course Analytics, Part 2 - When Are Our Students Online?

· Visual Analytics Inc.

· Learning from Key Learning Indicators

· Training Analytics: The Next Big Wave in Learning Management Technology

· Donald Kirkpatrick - Wikipedia, the free encyclopedia

· E-Learning Analytics,

ASTD Josh Bersin What to measure: efficiency, effectiveness, compliance

Girls Generation - Korean