1. Describe the vendor selection and evaluation process for Safety Related, Quality Augmented, Safety Related Commercial Grade, and Non Quality Related Procurements.
    • Image Upload 1
    • *Process Applies to Q, QAG, and CG (P01-P04)*
    • Non-Quality Related (P05) is still important since configuration is still important, but will require engineering review to determine inspection requirements
  2. What is the purpose of the ASL?
    • Ensure quality assurance program through evaluation and approval of vendors.
    • Ensure NRC requirements for QA will be satisfied.
  3. Who maintains the ASL?
  4. What quality class of items are placed on the ASL?
    • Q, QAG, CG
    • P02 & P03 Must be on ASL
  5. What are the classification levels of procurement?
    • P01: SR Commercial Grade
    • P02: SR ASME Section III
    • P03: SR Non-ASME Section III
    • P04: Quality Augmented (QAG)
    • P05: Non-Quality Related
    • P06: SR Low Risk Significant
  6. What are the different methods for procuring items?
    • Check the warehouse
    • Order from manufacturing
    • Another utilitie's ASL that has vendor not on PV's ASL (third party review or self-audit required)
    • Warehouse of another utility (NTA, Non-Taditional Aquisition, requires 3rd party review of paperwork)
    • Commercial Grade Dedication ("critical characteristics")
    • Modification - last resort
  7. Describe the receipt inspection process and describe engineering's role.
    • Items must be inspected at the warehouse before being installed or put in the plant.
    • A Release-for-Shipment form is filled once an inspection is complete.
    • Engineering: Determine's if a source verification plan is needed, the critical attributes of the part, and the classification of equipment
  8. Who inspects items at the warehouse?
    • QC Receiving
    • Qualified individual per ANSI 45.2.6
  9. Describe the scope of the WDN process.
    • Identify, document, segregrate, and resolve issues related ot nonconforming material
    • Part of CAP process
    • Items are quarantined until issue is resolved
  10. What is engineering's role in providing input to performance-based audits of vendors?
    • Technical Characteristics
    • Acceptance Criteria
    • Supplier's Method of Control
  11. What is NUPIC and why do we participate?
    • Nuclear Utilities Procurement Issues Committee
    • Industry alliance that shares audits to qualify vendors every three years
    • Reasons: Cost Savings and Leverage
  12. Explain P01
    • S-R Commercial Grade
    • Part has defined "critical characteristics" to adhere to through testing, inspection, etc.
    • Alternatively, the supplier's QA program can be audited
    • Inspected at warehouse
  13. Explain P02
    • S-R ASME III Qualified
    • Must be on ASL
    • Parts inspected at warehouse
  14. Explain P03
    • S-R Non-ASME III Qualified
    • Must be on ASL
    • Parts inspected at warehouse
  15. Explain P04
    • QAG
    • Configuration is still important; Inspected upon recieving
    • Fire Protetion, Rad Waste, Seismic 9 Criteria, etc.
  16. Explain P05
    • Non-Quality Related
    • Purchase requirements in description
    • RI to evaluate QA requirements
    • Relevant documentation as requested
    • Standard warehouse receiving inspection
  17. Explain P06
    • S-R Low Risk Significant
    • Don't use this anymore
  18. What are the NRC QA terms and how do they relate to PV QA terms?
    • NRC VS. PV:
    • Safety Related vs. Quality
    • Non-Safety Related Important to Safety vs. QAG
    • Non-Safety Related vs. Non-Quality Related
  19. What is involved with Level I Verification?
    • Worker Verification
    • Supervisory Verification
    • Second Party Verification
    • Independent Verification
    • Independent Inspection
  20. What is involved in a Level II Verification?
    Survey, Surveillance, Monitoring, and Documentation Review
  21. What engineering products are reviewed by NAD?
    • Design Inputs Requirements Cecklist
    • Design Output Documents
    • Calculations
    • Procedural Compliance
    • Licensing Basis Comliance
    • Human Performance Tools
  22. Where are Verification Requirements Delineated?
    • In Procedures:
    • Design Change Process
    • Calculations Procedure
    • Engineering Document Change Procedure
    • Material Enginering Evaluation Procedure
  23. NAD Process for Escalating Issues
    Elevated Station Quality Issue Statement
  24. How do Level II verifications relate to 10 CFR 50 Appendix B?
    Criterion X
  25. What are NAD's deliverables?
    • Evaluation Reports - Level II
    • Daily Summary Reports - Level III
  26. What classifications does the QA program include?
    • Q
    • QAG
    • Note: can include NQR if management dictates
  27. Where can you find classification of SSC's?
    • SWMS
    • UFSAR Ch. 3
    • UFSAR Ch. 17.2 (Appendix F - QAG programs; Fire Protection / Radwaste / Station Blackout / Siesmic / etc.)
  28. Who determines the classification of SSC's?
  29. Draw the PV commitment structure.
    Image Upload 2
  30. What is engineering's role in Level I verification?
    • Identify acceptance and rejection criteria
    • Identify specifications (installation specifications)
    • Identify critical attributes
  31. What is engineering's role in identifying critical attributes?
    • Inspection
    • Performance Testing
  32. Describe the engineering process and second party verifications.
    Image Upload 3
  33. What is NAD's engineering oversight role?
    • 1. UFSAR Ch. 18.I.B.1.2 Independent Safety review group
    •     Perform independent reviews and audits of plant activities such as maintenance, modifications, operations.
    • 2. UFSAR Ch. 17.2 - Level II Verifications
  34. Who performs Independent Inspections?
    • NAD Performs when QC Hold Point is in WO
    • 1. Cable Pulling
    • 2. Randomly when NAD deems it necessary
  35. 10 CFR 50 - Appendix B Criterion I
    I. Organization
  36. 10 CFR 50 - Appendix B Criterion II
    II. QA Program
  37. 10 CFR 50 - Appendix B Criterion III
    III. Design Control
  38. 10 CFR 50 - Appendix B Criterion IV
    IV. Procurement Document Control
  39. 10 CFR 50 - Appendix B Criterion V
    V. Instructions, Procedures, Drawings
  40. 10 CFR 50 - Appendix B Criterion VI
    VI. Document Control
  41. 10 CFR 50 - Appendix B Criterion VII
    VII. Control of Purchased Material, Equipment, and Services
  42. 10 CFR 50 - Appendix B Criterion VIII
    VIII. Identification and Control of Materials, Parts, and Components
  43. 10 CFR 50 - Appendix B Criterion IX
    IX. Control of Special Processes
  44. 10 CFR 50 - Appendix B Criterion X
    X. Inspection
  45. 10 CFR 50 - Appendix B Criterion XI
    XI. Test Control
  46. 10 CFR 50 - Appendix B Criterion XII
    XII Control of Measuring and Test Equipment
  47. 10 CFR 50 - Appendix B Criterion XIII
    XIII. Handling, Storage, and Shipping
  48. 10 CFR 50 - Appendix B Criterion XIV
    XIV. Inspection, Test, and Operating Status
  49. 10 CFR 50 - Appendix B Criterion XV
    XV. Nonconforming Materials, Parts, or Components
  50. 10 CFR 50 - Appendix B Criterion XVI
    XVI. Corrective Action
  51. 10 CFR 50 - Appendix B Criterion XVII
    XVII. QA Records
  52. 10 CFR 50 - Appendix B Criterion XVIII
    XVIII. Audits
  53. What are the 4 parts to an audit?
    • 1. Preparation
    • 2. Perform
    • 3. Report
    • 4. Follow-Up
  54. Explain the planning step of an audit.
    Inputs: OSRC Management -> Issue Audit Plan -> Develop Audit CL using MAPS
  55. Explain the Performance step of an audit.
    • Review of objective evidence (Observations, PVARS, interviews, etc.)
    • Exit Meeting
  56. Explain the reporting step of an audit.
    Exit meeting report issued to management.
  57. Explain the follow-up step of an audit.
    Use CAP for deficiencies and recommendations
  58. What are the regulatory requirements for audits?
    • Presented in 10 CFR 50 Appendix B
    • All criteria audited every 24 months
  59. How is the PVNGS committment structure for audits defined?
    • 10 CFR 50 Appendix B Criterion XVIII –Defines QA Audit Requirements 
    • USFAR – Defines a three level approach for reviews at PV (audits are Level III)
    • UFSAR 13.4 – Defines Level III programs to be audited at PV 
    • Procedures – Define the method and responsibilities involves with auditing internally and externally
  60. What is the purpose of an audit?
    To verify the effectiveness of a program.
  61. Draw the Performance Improvement Model
    Image Upload 4
  62. What are the elements of Performance Monitoring?
    • Performance Assessment
    • Performance Indicators
    • Benchmarking
    • Self-Assessments
    • Industry OE
    • Independent Oversight
    • Behavior Observations
    • Problem Reporting
    • Standards
    • Effectiveness Reviews
    • Trending
  63. What are the elements of Analyzing, Identifying, and Planning Solutions?
    • Action Planning
    • Problem Analysis
    • Management Review and Approval
    • Business Planning and Considerations
  64. What are the elements of Implementing Solutions?
    • Task Assignment
    • Action Tracking
    • Resource Management
    • Management Oversight / Reinforcement
    • Organizational Accountability
  65. What are the elements of Excellence in Performance Improvement?
    • Leadership and Oversight
    • Knowledge and Skills
    • Culture
  66. Draw the CAP Flowchart
  67. What are the sources/types of OE?
    • Internal - System IQ, Failure Data Trending (FDT), CRDR Trending (Trend-O-Matic/Tomcat)
    • External - INPO, NRC, WANO, NEI, STARS, EPRI, etc.
  68. Explain the negative forces mentioned in SOER 10-2
    • Leaders not Overseeing Work
    • Weak Fundamental Knowledge
    • Risk Acceptance
    • Deviations from Standards
    • Tolerating Long-Standing Issues
    • Not Using OE
  69. Discuss the CAP S.M.A.R.T.E.R. concept.
    • SMART - CAP
    • Specific
    • Measureable
    • Achievable
    • Relevant
    • Timely
    • Effective
    • Review
  70. Explain the reasoning and idea behind the change management model.
    • policy guide issued as a response to 2008 CAL
    • Leader's error prevention tool
    • Attachments: checklists and assessment aid to guide leaders through each section of the RAPID model
  71. What are the elements of the change management model?
    • Recognize the change and need to manage
    • Assess the complexity and risk
    • Plan the change, involving steak holders
    • Implement the plan, focusing on communication
    • Drive to conclusion and evaluate the effectiveness
  72. Explain the Integrated Performance Assessment and the areas the IPA applies to.
    • Proactive approach to resolve issues
    • Using a variety of performance information
    • Idea: identify gaps to excellence and improve
    • Info contained in INPO guides as well as Policy Guide 1304-02
    • Monthly/Quarterly meetings
  73. What are the areas that the IPA process apllies to?
    • Overall plant performance & organizational effectiveness
    • Program Process & Performance
    • Human Performance
  74. What data is used in the IPA process?
    • PI&R Data (Trend-O-Matic, TOMCAT, PVAR ADHOC, etc.)
    • Key Performance Indicators and Metrics (Current Issues, Best Industry Standards)
    • Observation Database
    • Self-Assessment and Benchmarking Results
    • Pertinent Industry OE
  75. Explain the different types of Self-Assessments and Benchmarks
    • Formal S-A (Integrated, Departmental)
    • Simple S-A
    • Formal BM
    • Simple BM (can include reverse BMs)
    • Details located in "PVNGS Self-Assessment and Benchmarking" Procedure
  76. What are the different priority levels (2-5)
    • 2: action to prevent recurrance
    • 3: action to minimize recurrance
    • 4: enhancements, not a part of CAP
    • 5: long term business actions, not a part of CAP
  77. What are the types of OE?
    • IER Levels 1-4
    • NRC and Other IOE Documents
    • Daily OE Report
    • Internal OE
  78. Where does PV gather internal OE from?
    • System IQ
    • Failure Data Trending (FDT)
    • CRDR Trending (Trend-O-Matic, TOMCAT, etc.)
    • SWMS
    • Lessons Learned Database
    • S-A and B-M
  79. Describe engineering's role involving the "Systematic Troubleshooting" Procedure
    • Appendix A: Engineering
    • Appendix B & C: Maintenance
  80. What is engineering's responsibility following a reactor trip?
    Present results of evaluation and sequence of events to Investigation and Management Response Team within 24 hours.
  81. Where are QAG systems defined?
    UFSAR 17 Appendix F
  82. What requirement does the Discovery checklist satisfy?
    10 CFR App. B Criterion XV
  83. What is specified in UFSAR 17.2?
    The QA program and the three level approach
  84. What is specified in UFSAR 1.8?
    The regulatory guides PV adheres to
  85. What is specified in UFSAR 3.2?
    Classification of SSC's.
  86. What is specified in UFSAR 13.4?
  87. How are CRDRs classified using Appendix E?
    • Correct the Condition
    • Determine and Correct the Extent of Condition
    • Determine the Apparent Cause
    • Correct the Cause
    • Determine the Root Cause
    • Determine and Correct the Extent of Cause
  88. What are the steps in resolving a SIG CRDR?
    • Assemble Team: never <4
    • Charter: who, what, how, scope
    • CARB: Leadership - do you have what you need?
    • Analysis: at least two evaluation methods, identify cause
    • Create Corrective Action: prevent reoccurance
Card Set