magento-index-analyst
Scannednpx machina-cli add skill maxnorm/magento2-agent-skills/magento-index-analyst --openclawMagento 2 Index Analyst
Expert specialist in designing and implementing high-performance indexing strategies that dramatically improve search performance, catalog browsing, and overall application responsiveness.
When to Use
- Optimizing search performance
- Configuring Elasticsearch
- Designing database indexes
- Improving reindexing strategies
- Troubleshooting indexing issues
- Planning indexing architecture
Magento Indexing Architecture
- Indexer Types: Master all Magento indexers and their optimization strategies
- Index Management: Expert in index lifecycle management and maintenance
- Reindexing Strategies: Optimize reindexing processes and scheduling
- Index Storage: Optimize index storage and data structures
- Performance Monitoring: Monitor and analyze index performance metrics
Index Types
Magento Core Indexers
- Catalog Product: Optimize product catalog indexing for fast browsing
- Catalog Category: Optimize category hierarchy and navigation indexing
- Catalog Search: Optimize search indexing for fast and relevant results
- Stock Indexer: Optimize inventory indexing for real-time stock status
- Price Indexer: Optimize pricing indexing for dynamic pricing
- Customer Grid: Optimize customer data indexing for admin grids
Custom Indexers
- Create custom indexers for specific business needs
- Implement indexer classes extending
AbstractIndexer - Design efficient index data structures
- Optimize index update processes
Elasticsearch Configuration
Setup
// app/etc/env.php
'system' => [
'default' => [
'catalog' => [
'search' => [
'engine' => 'elasticsearch7',
'elasticsearch7_server_hostname' => 'localhost',
'elasticsearch7_server_port' => '9200',
'elasticsearch7_index_prefix' => 'magento2',
]
]
]
]
Index Management
# Reindex all
bin/magento indexer:reindex
# Reindex specific indexer
bin/magento indexer:reindex catalogsearch_fulltext
# Index status
bin/magento indexer:status
# Reset indexer
bin/magento indexer:reset catalogsearch_fulltext
Database Indexing
Index Strategy
- Primary Keys: Design efficient primary key structures
- Foreign Keys: Implement proper foreign key relationships
- Composite Indexes: Create composite indexes for common queries
- Covering Indexes: Design indexes that cover query requirements
- Index Maintenance: Regular index maintenance and optimization
Query Optimization
- EXPLAIN Analysis: Analyze query execution plans
- Slow Query Log: Monitor and optimize slow queries
- Index Usage: Ensure indexes are being used effectively
- Query Rewriting: Optimize queries for better index usage
- N+1 Problem: Eliminate N+1 query problems
Index Optimization Process
1. Index Assessment & Analysis
- Current State Analysis: Assess existing indexing configuration and performance
- Performance Baseline: Establish baseline metrics for indexing performance
- Bottleneck Identification: Identify indexing bottlenecks and performance issues
- Usage Pattern Analysis: Analyze search and browsing usage patterns
- Capacity Planning: Plan indexing infrastructure capacity and resources
2. Index Strategy Design
- Indexing Architecture: Design optimal indexing architecture and topology
- Reindexing Strategy: Design efficient reindexing processes and schedules
- Storage Strategy: Optimize index storage and data organization
- Performance Goals: Define indexing performance targets and SLAs
- Scalability Planning: Plan for indexing scalability and growth
3. Implementation & Configuration
- Elasticsearch Setup: Configure and optimize Elasticsearch clusters
- Indexer Configuration: Optimize Magento indexer settings and behavior
- Database Indexing: Implement optimal database index strategies
- Monitoring Setup: Implement comprehensive indexing monitoring
- Automation Setup: Automate indexing processes and maintenance
4. Testing & Optimization
- Performance Testing: Validate indexing performance improvements
- Load Testing: Test indexing behavior under high load conditions
- Search Quality Testing: Validate search relevance and accuracy
- Monitoring Validation: Verify monitoring and alerting effectiveness
- Continuous Optimization: Establish ongoing indexing optimization
Best Practices
Reindexing Strategy
- Scheduled Reindexing: Schedule reindexing during low-traffic periods
- Incremental Reindexing: Use incremental reindexing when possible
- Parallel Reindexing: Run independent indexers in parallel
- Reindexing Monitoring: Monitor reindexing performance and failures
- Rollback Planning: Plan for reindexing failures and rollbacks
Elasticsearch Optimization
- Cluster Configuration: Optimize Elasticsearch cluster settings
- Shard Strategy: Design optimal shard allocation
- Replica Configuration: Configure appropriate replica counts
- Query Optimization: Optimize search queries and aggregations
- Index Mapping: Design efficient search index mappings
Database Index Optimization
- Index Design: Design indexes based on query patterns
- Index Maintenance: Regular index maintenance and optimization
- Query Analysis: Analyze and optimize slow queries
- Index Monitoring: Monitor index usage and effectiveness
- Performance Tuning: Tune database for optimal index performance
Monitoring
- Index Status: Monitor indexer status and health
- Reindexing Performance: Track reindexing duration and resource usage
- Search Performance: Monitor search query performance
- Index Size: Monitor index storage size and growth
- Error Monitoring: Monitor indexing errors and failures
References
Focus on creating high-performance indexing strategies that improve search and browsing performance.
Source
git clone https://github.com/maxnorm/magento2-agent-skills/blob/main/skills/magento-index-analyst/SKILL.mdView on GitHub Overview
An expert in designing and implementing high-performance indexing strategies that dramatically improve search performance, catalog browsing, and overall application responsiveness. This skill covers indexer optimization, Elasticsearch configuration, and database indexing to deliver faster queries and scalable indexing workflows.
How This Skill Works
Technically, it combines mastering Magento indexers, lifecycle management, and efficient index data structures. It also configures Elasticsearch in env.php, tunes index storage, and uses Magento CLI tools to reindex, monitor, and optimize index performance.
When to Use It
- Optimizing search performance
- Configuring Elasticsearch
- Designing database indexes
- Improving reindexing strategies
- Troubleshooting indexing issues
Quick Start
- Step 1: Audit current indexing setup and establish performance baselines
- Step 2: Configure Elasticsearch (env.php) and identify key indexers to optimize
- Step 3: Run reindexing, monitor metrics, and iteratively refine indexing strategy
Best Practices
- Master all Magento indexers and their optimization strategies
- Implement robust index lifecycle management and regular maintenance
- Design efficient reindexing processes and schedules
- Optimize index storage and data structures for retrieval
- Monitor and analyze index performance metrics regularly
Example Use Cases
- Reindex the full catalog after bulk imports using bin/magento indexer:reindex
- Configure Elasticsearch 7 in app/etc/env.php with magento2 prefix for fast, relevant search
- Create composite and covering indexes for common queries on catalog_product and catalog_category
- Implement a custom indexer that updates business-specific data structures
- Set up index lifecycle management and performance monitoring in production