Describe the vendor selection and evaluation process for Safety Related, Quality Augmented, Safety Related Commercial Grade, and Non Quality Related Procurements.
- *Process Applies to Q, QAG, and CG (P01-P04)*
- Non-Quality Related (P05) is still important since configuration is still important, but will require engineering review to determine inspection requirements
What is the purpose of the ASL?
- Ensure quality assurance program through evaluation and approval of vendors.
- Ensure NRC requirements for QA will be satisfied.
Who maintains the ASL?
What quality class of items are placed on the ASL?
- Q, QAG, CG
- P02 & P03 Must be on ASL
What are the classification levels of procurement?
- P01: SR Commercial Grade
- P02: SR ASME Section III
- P03: SR Non-ASME Section III
- P04: Quality Augmented (QAG)
- P05: Non-Quality Related
- P06: SR Low Risk Significant
What are the different methods for procuring items?
- Check the warehouse
- Order from manufacturing
- Another utilitie's ASL that has vendor not on PV's ASL (third party review or self-audit required)
- Warehouse of another utility (NTA, Non-Taditional Aquisition, requires 3rd party review of paperwork)
- Commercial Grade Dedication ("critical characteristics")
- Modification - last resort
Describe the receipt inspection process and describe engineering's role.
- Items must be inspected at the warehouse before being installed or put in the plant.
- A Release-for-Shipment form is filled once an inspection is complete.
- Engineering: Determine's if a source verification plan is needed, the critical attributes of the part, and the classification of equipment
Who inspects items at the warehouse?
- QC Receiving
- Qualified individual per ANSI 45.2.6
Describe the scope of the WDN process.
- Identify, document, segregrate, and resolve issues related ot nonconforming material
- Part of CAP process
- Items are quarantined until issue is resolved
What is engineering's role in providing input to performance-based audits of vendors?
- Technical Characteristics
- Acceptance Criteria
- Supplier's Method of Control
What is NUPIC and why do we participate?
- Nuclear Utilities Procurement Issues Committee
- Industry alliance that shares audits to qualify vendors every three years
- Reasons: Cost Savings and Leverage
- S-R Commercial Grade
- Part has defined "critical characteristics" to adhere to through testing, inspection, etc.
- Alternatively, the supplier's QA program can be audited
- Inspected at warehouse
- S-R ASME III Qualified
- Must be on ASL
- Parts inspected at warehouse
- S-R Non-ASME III Qualified
- Must be on ASL
- Parts inspected at warehouse
- Configuration is still important; Inspected upon recieving
- Fire Protetion, Rad Waste, Seismic 9 Criteria, etc.
- Non-Quality Related
- Purchase requirements in description
- RI to evaluate QA requirements
- Relevant documentation as requested
- Standard warehouse receiving inspection
- S-R Low Risk Significant
- Don't use this anymore
What are the NRC QA terms and how do they relate to PV QA terms?
- NRC VS. PV:
- Safety Related vs. Quality
- Non-Safety Related Important to Safety vs. QAG
- Non-Safety Related vs. Non-Quality Related
What is involved with Level I Verification?
- Worker Verification
- Supervisory Verification
- Second Party Verification
- Independent Verification
- Independent Inspection
What is involved in a Level II Verification?
Survey, Surveillance, Monitoring, and Documentation Review
What engineering products are reviewed by NAD?
- Design Inputs Requirements Cecklist
- Design Output Documents
- Procedural Compliance
- Licensing Basis Comliance
- Human Performance Tools
Where are Verification Requirements Delineated?
- In Procedures:
- Design Change Process
- Calculations Procedure
- Engineering Document Change Procedure
- Material Enginering Evaluation Procedure
NAD Process for Escalating Issues
Elevated Station Quality Issue Statement
How do Level II verifications relate to 10 CFR 50 Appendix B?
What are NAD's deliverables?
- Evaluation Reports - Level II
- Daily Summary Reports - Level III
What classifications does the QA program include?
- Note: can include NQR if management dictates
Where can you find classification of SSC's?
- UFSAR Ch. 3
- UFSAR Ch. 17.2 (Appendix F - QAG programs; Fire Protection / Radwaste / Station Blackout / Siesmic / etc.)
Who determines the classification of SSC's?
Draw the PV commitment structure.
What is engineering's role in Level I verification?
- Identify acceptance and rejection criteria
- Identify specifications (installation specifications)
- Identify critical attributes
What is engineering's role in identifying critical attributes?
- Performance Testing
Describe the engineering process and second party verifications.
What is NAD's engineering oversight role?
- 1. UFSAR Ch. 18.I.B.1.2 Independent Safety review group
- Perform independent reviews and audits of plant activities such as maintenance, modifications, operations.
- 2. UFSAR Ch. 17.2 - Level II Verifications
Who performs Independent Inspections?
- NAD Performs when QC Hold Point is in WO
- 1. Cable Pulling
- 2. Randomly when NAD deems it necessary
10 CFR 50 - Appendix B Criterion I
10 CFR 50 - Appendix B Criterion II
II. QA Program
10 CFR 50 - Appendix B Criterion III
III. Design Control
10 CFR 50 - Appendix B Criterion IV
IV. Procurement Document Control
10 CFR 50 - Appendix B Criterion V
V. Instructions, Procedures, Drawings
10 CFR 50 - Appendix B Criterion VI
VI. Document Control
10 CFR 50 - Appendix B Criterion VII
VII. Control of Purchased Material, Equipment, and Services
10 CFR 50 - Appendix B Criterion VIII
VIII. Identification and Control of Materials, Parts, and Components
10 CFR 50 - Appendix B Criterion IX
IX. Control of Special Processes
10 CFR 50 - Appendix B Criterion X
10 CFR 50 - Appendix B Criterion XI
XI. Test Control
10 CFR 50 - Appendix B Criterion XII
XII Control of Measuring and Test Equipment
10 CFR 50 - Appendix B Criterion XIII
XIII. Handling, Storage, and Shipping
10 CFR 50 - Appendix B Criterion XIV
XIV. Inspection, Test, and Operating Status
10 CFR 50 - Appendix B Criterion XV
XV. Nonconforming Materials, Parts, or Components
10 CFR 50 - Appendix B Criterion XVI
XVI. Corrective Action
10 CFR 50 - Appendix B Criterion XVII
XVII. QA Records
10 CFR 50 - Appendix B Criterion XVIII
What are the 4 parts to an audit?
- 1. Preparation
- 2. Perform
- 3. Report
- 4. Follow-Up
Explain the planning step of an audit.
Inputs: OSRC Management -> Issue Audit Plan -> Develop Audit CL using MAPS
Explain the Performance step of an audit.
- Review of objective evidence (Observations, PVARS, interviews, etc.)
- Exit Meeting
Explain the reporting step of an audit.
Exit meeting report issued to management.
Explain the follow-up step of an audit.
Use CAP for deficiencies and recommendations
What are the regulatory requirements for audits?
- Presented in 10 CFR 50 Appendix B
- All criteria audited every 24 months
How is the PVNGS committment structure for audits defined?
- 10 CFR 50 Appendix B Criterion XVIII –Defines QA Audit Requirements
- USFAR 188.8.131.52 – Defines a three level approach for reviews at PV (audits are Level III)
- UFSAR 13.4 – Defines Level III programs to be audited at PV
- Procedures – Define the method and responsibilities involves with auditing internally and externally
What is the purpose of an audit?
To verify the effectiveness of a program.
Draw the Performance Improvement Model
What are the elements of Performance Monitoring?
- Performance Assessment
- Performance Indicators
- Industry OE
- Independent Oversight
- Behavior Observations
- Problem Reporting
- Effectiveness Reviews
What are the elements of Analyzing, Identifying, and Planning Solutions?
- Action Planning
- Problem Analysis
- Management Review and Approval
- Business Planning and Considerations
What are the elements of Implementing Solutions?
- Task Assignment
- Action Tracking
- Resource Management
- Management Oversight / Reinforcement
- Organizational Accountability
What are the elements of Excellence in Performance Improvement?
- Leadership and Oversight
- Knowledge and Skills
What are the sources/types of OE?
- Internal - System IQ, Failure Data Trending (FDT), CRDR Trending (Trend-O-Matic/Tomcat)
- External - INPO, NRC, WANO, NEI, STARS, EPRI, etc.
Explain the negative forces mentioned in SOER 10-2
- Leaders not Overseeing Work
- Weak Fundamental Knowledge
- Risk Acceptance
- Deviations from Standards
- Tolerating Long-Standing Issues
- Not Using OE
Discuss the CAP S.M.A.R.T.E.R. concept.
- SMART - CAP
- SMARTER - CAPR
Explain the reasoning and idea behind the change management model.
- policy guide issued as a response to 2008 CAL
- Leader's error prevention tool
- Attachments: checklists and assessment aid to guide leaders through each section of the RAPID model
What are the elements of the change management model?
- Recognize the change and need to manage
- Assess the complexity and risk
- Plan the change, involving steak holders
- Implement the plan, focusing on communication
- Drive to conclusion and evaluate the effectiveness
Explain the Integrated Performance Assessment and the areas the IPA applies to.
- Proactive approach to resolve issues
- Using a variety of performance information
- Idea: identify gaps to excellence and improve
- Info contained in INPO guides as well as Policy Guide 1304-02
- Monthly/Quarterly meetings
What are the areas that the IPA process apllies to?
- Overall plant performance & organizational effectiveness
- Program Process & Performance
- Human Performance
What data is used in the IPA process?
- PI&R Data (Trend-O-Matic, TOMCAT, PVAR ADHOC, etc.)
- Key Performance Indicators and Metrics (Current Issues, Best Industry Standards)
- Observation Database
- Self-Assessment and Benchmarking Results
- Pertinent Industry OE
Explain the different types of Self-Assessments and Benchmarks
- Formal S-A (Integrated, Departmental)
- Simple S-A
- Formal BM
- Simple BM (can include reverse BMs)
- Details located in "PVNGS Self-Assessment and Benchmarking" Procedure
What are the different priority levels (2-5)
- 2: action to prevent recurrance
- 3: action to minimize recurrance
- 4: enhancements, not a part of CAP
- 5: long term business actions, not a part of CAP
What are the types of OE?
- IER Levels 1-4
- NRC and Other IOE Documents
- Daily OE Report
- Internal OE
Where does PV gather internal OE from?
- System IQ
- Failure Data Trending (FDT)
- CRDR Trending (Trend-O-Matic, TOMCAT, etc.)
- Lessons Learned Database
- S-A and B-M
Describe engineering's role involving the "Systematic Troubleshooting" Procedure
- Appendix A: Engineering
- Appendix B & C: Maintenance
What is engineering's responsibility following a reactor trip?
Present results of evaluation and sequence of events to Investigation and Management Response Team within 24 hours.
Where are QAG systems defined?
UFSAR 17 Appendix F
What requirement does the Discovery checklist satisfy?
10 CFR App. B Criterion XV
What is specified in UFSAR 17.2?
The QA program and the three level approach
What is specified in UFSAR 1.8?
The regulatory guides PV adheres to
What is specified in UFSAR 3.2?
Classification of SSC's.
What is specified in UFSAR 13.4?
How are CRDRs classified using Appendix E?
- Correct the Condition
- Determine and Correct the Extent of Condition
- Determine the Apparent Cause
- Correct the Cause
- Determine the Root Cause
- Determine and Correct the Extent of Cause
What are the steps in resolving a SIG CRDR?
- Assemble Team: never <4
- Charter: who, what, how, scope
- CARB: Leadership - do you have what you need?
- Analysis: at least two evaluation methods, identify cause
- Create Corrective Action: prevent reoccurance