February 19, 2020 Delivery WG Call Notes
Contents
Action Items
Attendees
Zac, Jeff, Chris, Nick, Brian, Sarah
Agenda
- Welcome and introduce new WG members
- WG charter discussion
- Review and update task list
- Discuss how to interface with the Coordination WG
- Develop instructors/auditors evaluation instrument
Call Notes
Action Items
- Zac - develop a draft charter for this WG
- Kara - contact EPA about posting the instructor list on the EPA Sharepoint
- Jeff - get the list of the curriculum areas that will be used in the new LMS for adding to the instructor list
- Jeff - develop a task list for updating instructor list, and circulate to Sarah and Brian with a charge on how to break up the list review
- Kara and Zac - send Jeff updated instructor lists
- Kara - send this group the latest Word version of the instructor recruitment flyer
- Chris - check in getting the new student eval instrument integrated into APTI-Learn
Welcome and introduce new WG members
- Sarah Matthews (EPA) - works on training team at OAQPS, started in July 2019; work focus on development of the new curricula, and working on the FLAG program; background in education, classroom teacher for 6 years, focused on professional development for school staff; worked on revamping the curricula for middle-school social studies county wide; worked on refreshing teaching approaches; veteran, active duty army;
- Nick Kilby (AAPCA) - interested in getting more involved with the JTC; AAPCA members will be most interested in this; looking to gather infomration to pass on; worked in professional development training in a previous role, some experience with training delivery, and also host training options at AAPCA
- Brian Foster (TCEQ/AAPCA) - worked TCEQ for 26 years in planning and SIP development; coordinates professional training for office of air at TCEQ; was on WG 3 several years ago working on instructor assessment; interested in recruitment of new instructors, will be able to coordinate with AAPCA and NACAA to bring in new instructors
- Kara Murphy (NESCAUM) - planning and support WG looking to support communication across the JTC; sitting in to see if there are communication tasks that they can help out with
WG charter discussion (10 min)
- Elements
- Leader & membership
- Reporting/Meeting Schedules
- Purpose & Objectives, include a mission statement
- Member Expectations
- Scope, clarify where workgroup work begins/ends
- Operating Guidelines
- Expected Outcomes, what are the deliverables & timelines; when is the WG done, does it have a finite life?
- Decision making process
Review and update task list (10 min)
- Develop/maintain list of instructors by subject categories and course topics.
- Jeff is working through the list adding new people from MARAMA and LADCO
- Trying to sort through trade groups, contractors, individuals
- Arduous process working on the document
- It needs to be done consistently rather than as an ad hoc process
- What is the state of the list? In the process of updating contacts, needs to list speciality of the person/group, would like to get it to a point where a state training coordinator can pick it up to identify trainers for a particular subject area; adding website URLs and emails; could also use a course number field; need to check with instructors to confirm that they're still active; cross reference with LADCO, NESCAUM, and MARAMA lists for completeness
- Where should the list be housed? Move from Jeff to the EPA sharepoint to support centralized access/editing; eventually get the sharepoint version of the list into the new LMS and maintain the list there;
- Brian and Sarah can help break up the tasks of going through the instructor list; Jeff to provide instruction on how to break it up
- Jeff to create a set of tasks needed for the instructor list: what needs to be done to get this list ready for import to the new LMS database?
- Need to identify the database "join" fields with the course/curriculum database: e.g., cross-reference instructors with curriculum areas and courses; find the list of curriculum areas that will be used to categorize courses in the new LMS
- Jeff has been maintaining a list for 15 years, this task will work on centralizing and crowd-sourcing the maintenance in the new LMS
- EPA sharepoint will be used to maintain the course materials list, can also use this Sharepoint to maintain the instructor list; Kara will check with EPA on this
- Propose to LMS workgroup that instructor inventory is part of the database; target instructor list being included and maintained in the LMS
- Develop and implement a process for recruitment of new instructors.
- Discuss on next call
- Get flyer from Kara
- Develop and implement use of improved tools for evaluation of instructors and course materials.
- Course evaluation update into APTI-Learn, Chris will check on this
- Oversee interactions with instructors to address needed improvements to instructional materials and to provide other course support.
- Brainstorm instructor eval on next call
- Develop and implement delivery format alternatives for all courses including classroom and e-learning/distance learning.
- Zac to post recording of the delivery format webinar to the WG wiki
- Delivery format document for posting
- Once these are posted, MJOs can broadcast their availability to the state/local training coordinators
- Provide updates to instructors regarding course library additions and updates.
- Provide information to instructors on use of LMS functionalities and enhancements to aid them in fulfilling their instructor roles for downloading and uploading information to the LMS.
Discuss how to interface with the Coordination WG (10 min)
Develop instructors/auditors evaluation instrument (10 min)
- Course summary reports from instructors historically had been collected from EPA
- WESTAR is creating these (so are some other MJOs) reports, but don’t know how they’re getting back to EPA
- Summary reports have space for instructors and course auditors to provide feedback
- One challenge is to identify which materials are being taught and how they compare to what’s in the national LMS
- Think about survey tools, and how to match a training contractor with the materials that they taught from; this should be a functionality in the LMS
- Example with air dispersion modeling: EPA course, Lakes, Trinity, and Providence ??; some overlap in materials, but a lot of propriety too, could cause confusion in associating evaluation with the materials
- Amy hasn’t experienced great surveys in LMSs, star ratings usually; whatever survey you create does it need to be in there, or could it be triggered by the LMS; send link to students; may be a need to have an external software, and then somehow link the results back to the LMS and associate with the training materials/course/instructor
- Preferable to have the eval in the LMS, but not sure how feasible
- Would there need to be separate instruments from the instructor and auditor?
- Are the questions different between instructor and expert auditor
- Both instruments could have some common questions, but auditor would provide feedback on delivery and materials; instructor on materials and training logistics/course
- Amy thinks they should be separate instruments
- Jeff questions whether it’s generally the case that there is an auditor in the course, probably not;
- Start with some information that we would like to know about; target a single instrument to keep it simple
- What information do we need to know
- New information that’s not in the class; what’s dated
- Errors/inaccuracies/typos in the materials
- Try to get a template/format for the instructors to provide feedback into; need to prompt for specific questions
Next Call
- Wednesday March 18, 2020 @ 11:00 Central
- Brainstorm instructor eval instrument and instructor recruitment
