Technical Advisory Board (TAB)

 View Only
  • 1.  OASIS survey

    Posted 11-27-2010 18:30
    Mary,
    
    I am not sure specific questions about a visit to the OASIS site are
    appropriate. 
    
    Asking someone if they found information before they had a chance to
    look for it seems rather odd. Ditto on difficulty of finding. 
    
    Asking them to rate the site more generally about finding information
    might be more informative. 
    
    Hope you are having a great weekend!
    
    Patrick
    -- 
    Patrick Durusau
    patrick@durusau.net
    Chair, V1 - US TAG to JTC 1/SC 34
    Convener, JTC 1/SC 34/WG 3 (Topic Maps)
    Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300
    Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps)
    
    Another Word For It (blog): http://tm.durusau.net
    Homepage: http://www.durusau.net
    Twitter: patrickDurusau
    Newcomb Number: 1
    
    


  • 2.  Re: [tab] OASIS survey

    Posted 11-29-2010 15:27
    Patrick,
    
    First full disclosure:  The website survey is not Mary's wacky idea, it is mine.
    
    Second, I am happy to report that 183 people have figured out how to
    respond productively to the survey (actually one of those reported
    being stymied by seeing the survey first--the same thing you observe,
    and someone reports coming to the site looking for a rich wife.
    Therefore only 181 were productive)
    
    On your valid issue of timing, I'd appreciate any suggestions by which
    we could do something different.  Popping the survey as a stand-alone
    window, and having a  "later" link seemed like the most practical
    solution available.  Can you suggest a better mechanism?  (we already
    plan to add a link to the homepage as well)
    
    Truth be told, the survey came from your steady support for taking the
    users perspective into consideration.  You, me, TAB, board etc all
    have an idea of what the "typical" user wants, but we all look through
    our personal lens.  80% of the respondents are not members, so the
    survey, while imperfect, seems to be giving us a useful understanding
    despite the obvious execution flaws - including the most significant -
    it's a a popup window often blocked by pop-up blockers.
    
    Given the delivery imperfections which skews the respondent selection,
    do you think we should ignore this user input?
    
    Scott...
    
    On Sat, Nov 27, 2010 at 1:28 PM, Patrick Durusau 


  • 3.  Re: [tab] OASIS survey

    Posted 11-29-2010 16:34
    Scott,
    
    On Mon, 2010-11-29 at 10:26 -0500, Scott McGrath wrote:
    > Patrick,
    > 
    > First full disclosure:  The website survey is not Mary's wacky idea, it is mine.
    > 
    
    Err, I did not refer to it as a "wacky idea," I offered what I thought
    would be helpful criticism.
    
    > Second, I am happy to report that 183 people have figured out how to
    > respond productively to the survey (actually one of those reported
    > being stymied by seeing the survey first--the same thing you observe,
    > and someone reports coming to the site looking for a rich wife.
    > Therefore only 181 were productive)
    > 
    
    Good.
    
    > On your valid issue of timing, I'd appreciate any suggestions by which
    > we could do something different.  Popping the survey as a stand-alone
    > window, and having a  "later" link seemed like the most practical
    > solution available.  Can you suggest a better mechanism?  (we already
    > plan to add a link to the homepage as well)
    > 
    
    There are a couple of solutions I have seen, don't know if they work
    "better" or not.
    
    The first is the "Did this page answer your question?" sort of box that
    appears at the bottom of pages you find as the result of searching. 
    
    Less specific than this survey and uses a local mechanism so those would
    be downsides.
    
    The second is a variant of the first and would simply put a link to the
    survey (or have it pop-up) as a result of navigation to a page as the
    result of a search request. 
    
    Retains the specifics of the current survey but requires triggering on
    the basis of search results, which may also be a downside.
    
    Not to mention that both of these approaches miss users who simply use
    the website without using a search function. 
    
    > Truth be told, the survey came from your steady support for taking the
    > users perspective into consideration.  You, me, TAB, board etc all
    > have an idea of what the "typical" user wants, but we all look through
    > our personal lens.  80% of the respondents are not members, so the
    > survey, while imperfect, seems to be giving us a useful understanding
    > despite the obvious execution flaws - including the most significant -
    > it's a a popup window often blocked by pop-up blockers.
    > 
    
    I did not indicate that I thought the survey was a bad idea. 
    
    I merely suggested a couple of ways that the current questions might be
    improved. 
    
    > Given the delivery imperfections which skews the respondent selection,
    > do you think we should ignore this user input?
    > 
    
    No, not at all.
    
    But I do think you to *drop the defensive* stance every time I make a
    suggestion.
    
    Some of my suggestions, at least in my view, are pretty good. Some of my
    suggestions should be piped to /dev/null. But, they are all well
    intentioned, whether they fall into either of those categories or
    somewhere in between.
    
    If you read my initial post, it merely suggested some possible
    improvements in wording. I fail to see what was so outrageous about it. 
    
    Hope your week improves from its current start!
    
    Patrick
    
    
    > Scott...
    > 
    > On Sat, Nov 27, 2010 at 1:28 PM, Patrick Durusau 


  • 4.  Re: [tab] OASIS survey

    Posted 11-29-2010 17:04
    Hi Patrick,
    
    I think you misinterpreted my reply.  I did not mean to imply you
    thought the idea was wacky, I said it to be self-satirical.  And *I*
    acknowledged there were flaws with the execution which does skew the
    results, I did not intend to suggest you were being negative.
    
    I raised the possibility that the results represent a very small
    sample of users--not randomly selected as we'd like-- but perhaps
    selected by 1.) the lack of sophistication that leads to not using a
    pop-up blocker and 2.) the propensity to answer surveys in the first
    place;-)   I know you were not questioning the validity - I was
    raising that possibility to discussion.
    
    Sorry the discussion went askew.
    
    Scott...
    
    
    On Mon, Nov 29, 2010 at 11:33 AM, Patrick Durusau