Model Exploration and Parameter Optimization VIP Exclusive โ
Congratulations! The model is trained and the data is cleaned. Now let's put on our detective hat, pick up our magnifying glass, and step into the world of Model Exploration โ and let the algorithm tell you directly what the optimal process parameters should be. ๐ต๏ธโโ๏ธ
โ ๏ธ Prerequisite: You must first have a model that is activated and fitted (Fit) in the model list on the right.
Entry: Top toolbar โ expand the [Analysis & Exploration] dropdown (magnifying glass icon) โ Model Exploration
๐บ๏ธ Interface Overview โ
Model Exploration is a "cockpit" with very high information density, divided into six major blocks:
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ โ Axes & Model Metrics โ โก Scatter Plot (Explore/Search) โ โข T-Scores โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
โ โฃ 3D Optimization Surface (Loss Surface) โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
โ โค X-Space Feature Space โ โฅ Y-Space Target Space โ
โ + Violations (boundary violations) โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
โ โฆ Optimization Panel โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ โก The Scatter Plot and Its Two Modes โ
What greets your eyes is a scatter plot โ this is your "treasure map". Every gray dot is one of your historical records.
- Red circle (Ellipse): that is the safe harbor (confidence interval). Inside the circle is normal data; outside the circle there may be "treasure" or a "trap" (an outlier).
- Red dot (Target): that is the "position" you are currently exploring.
You can switch between two modes in the top right corner:
๐งญ Explore Mode: Finding the Optimal Solution โ
Imagine you are piloting a spaceship through the data universe.
- How to play? Just drag that red dot with the mouse!
- What is it for? When you move the red dot, you are actually simulating: "If my data point were at this position (T1, T2 scores), what should its original features (X) and predicted results (Y) be?"
- What happens behind the scenes? The platform invokes a reverse prediction algorithm to back-calculate the raw variable values from the scores.
- Real-time feedback: The X-Space & Y-Space panel below updates in real time as the red dot moves, telling you the theoretical value of every variable (such as temperature, pressure, or yield rate) at the current position.
๐ก This is the magic tool for "reverse optimization": drag the red dot into the region with the highest yield rate, and the X-Space below will tell you what the raw material ratio should be at that moment!
๐ Search Mode: Time Travel โ
- How to play? The red dot no longer obeys your commands; it becomes click-to-select. You can click any gray historical point on the plot.
- What is it for? When you click a point, the system instantly "travels back" to the moment that piece of data was generated.
- The truth revealed: the panel below immediately displays all the real values of that data at the time.
๐ก A typical use case: "What actually happened with that abnormal batch last time?" Click it once in Search Mode and all the parameters are clear at a glance.
โข T-Scores Score List โ
The top right corner shows the specific score values of the currently selected point on all principal components (t1, t2, t3 โฆ).
- In Explore Mode: shows the scores of the red dot's current position
- In Search Mode: shows the real scores of that historical sample
โฃ 3D Optimization Surface (Loss Surface) โ
Below the scatter plot is a 3D response surface plot:
| Axis | Meaning |
|---|---|
| X axis | t[xComponent] (such as t1) |
| Y axis | t[yComponent] (such as t2) |
| Z axis | Loss (loss value) |
It lays out the "goodness" of the entire latent space as a three-dimensional terrain map โ the bottom of the valley is the optimal region.
After you run the optimization, the surface also overlays the optimization path (the trajectory from the starting point to the optimal solution), and is linked with the playback control bar below.
โคโฅ X-Space and Y-Space: Variable Spaces โ
This is the most central output panel of Explore Mode.
| Panel | Content |
|---|---|
| X-Space (feature space) | On the left is your recipe (X variables). Shows the Raw Value (the real physical value, such as 100โ) and Bounds (upper and lower limits) |
| Y-Space (target space) | On the right is your target (Y variables). Shows the predicted values and their safe range |
๐ How the Bounds Are Determined โ
By default the platform uses two sets of bounds, each of which can be toggled on or off:
| Bound type | Rule |
|---|---|
| Standardized bounds | ยฑ 1.5 (standardized scale) |
| Raw bounds | mean ยฑ 1.5 ร standard deviation |
Values outside the range enter the alarm zone ๐จ.
๐ง Marking Variables as MV or DV โ
This is a key step for the optimization feature: click the tag next to a variable to set it as:
| Tag | Full name | Meaning |
|---|---|---|
| MV | Manipulated Variable | Manipulated variable โ one you can actively adjust (such as the set temperature) |
| DV | Disturbance Variable | Disturbance variable โ uncontrollable but affects the result (such as ambient humidity) |
๐ก Why is marking necessary? The optimization algorithm needs to know which variables can be adjusted and which can only be accepted. If you mistakenly mark a DV as an MV, the algorithm will give unexecutable advice such as "go adjust the ambient humidity".
For the complete methodology of variable classification, see Factory Scenario Data Modeling Guide.
โฆ Violations: Real-Time Boundary Violation List โ
The panel title looks like Violations (N) and lists, in real time, all variables that violate the boundary constraints at the current point.
- In Explore Mode, dragging the red dot outside the reasonable range โ this list immediately refreshes
- Each entry indicates the variable name and which bound it violates
๐ก Its practical value: the optimization algorithm may produce a point that is "mathematically optimal but physically impossible". Violations is your first checkpoint for judging "can this recommendation actually be implemented" โ if the list is long, that optimal solution will be hard to realize in reality.
๐ Optimization: The Optimization Engine โ
At the very bottom is the Optimization panel, responsible for automatically solving for the optimal parameters.
Parameter settings โ
| Parameter | Range/step | Meaning |
|---|---|---|
| Max Iter | 1 ~ 1000 | Maximum number of iterations, controlling the "patience" of the search |
| Tol | step size about 1e-6 | Convergence tolerance; smaller is more precise but slower |
Running โ
Click Run Optimization, and the algorithm automatically searches and returns the optimal solution together with the complete optimization path trajectory.
When it finishes, the status bar shows:
- โ
Optimization Convergedโโ converged successfully - โ
Optimization Failed: <reason>โโ did not converge (you can try loosening Tol or increasing Max Iter)
Path playback โ
After the result is obtained, a playback control bar appears below the panel:
- โถ๏ธ / โธ๏ธ Play/pause button โโ automatically plays the entire optimization process
- Slider โโ drag manually to any step
- Step label โโ looks like
12 / 48, current step / total steps
During playback, the red dot on the scatter plot, the path on the 3D surface, and the values in X/Y-Space all change in sync, so you can clearly see "how the algorithm walked step by step to the optimal solution".
๐ก Playback is not just for show: it helps you judge whether the algorithm "went astray". If the path loops around a lot before reaching the end, the optimal solution is very sensitive to the parameters and its robustness in actual production may be poor.
๐ง Companion Feature: Causal Inference (DML) โ
Location: The same [Analysis & Exploration] dropdown menu โ Causal Inference (DML)
โ ๏ธ Correlation โ causation. All the previous analyses (VIP, SHAP, correlation coefficients) tell you "who changes together with whom", not "changing whom will make the result better". DML is what bridges that gap.
How to use it โ
The interface provides three selectors:
| Selector | Meaning |
|---|---|
| Outcome variable (Y - Outcome) | The metric you want to improve |
| Treatment variable (T - Treatment) | The variable you intend to "move" |
| Confounder feature set (W - Confounders) | Other variables that need to be controlled for (to prevent spurious correlation) |
Once configured, click Run Causal Inference Engine.
๐ก A typical question: "Does raising the reaction temperature really increase the yield? Or is the higher temperature just because the raw materials were better?" DML uses double machine learning to strip out confounding factors and produce an effect estimate that is closer to causal.
๐ฏ Complete Hands-On Workflow โ
1. Fit a PLS / OPLS model
โ
2. Enter "Model Exploration"
โ
3. In X-Space, mark the adjustable variables as MV and the uncontrollable ones as DV
โ
4. Run Optimization (adjust Max Iter / Tol as needed)
โ
5. Play back the optimization path to confirm the algorithm did not go astray
โ
6. Check Violations: are all the variables of the optimal solution within the physically feasible range?
โ
7. Read the Raw Value in X-Space โ these are the recommended process parameters
โ
8. If you are unsure about causality โ use "Causal Inference (DML)" for further verification
โ
9. Run a pilot production, collect new data, and go back to step 1 to iterateโ ๏ธ Usage Notes โ
- The exploration result is the optimum "in the model's opinion", not something that is "definitely feasible in reality" โ be sure to judge it together with Violations and your process know-how
- Extrapolation is risky: dragging the red dot to a region far from the historical data significantly reduces the credibility of the model's predictions
- DV tags must be accurate: a wrong tag will make the optimization recommendations impossible to execute
- When you need temporal information: lag-type analysis requires the model to have used a "not random" split during training; see Lag Influence Analysis for details
๐ Related Reading โ
- Model Prediction (with Copy-Paste) โโ The sibling of reverse prediction: predicting Y from X
- Factory Scenario Data Modeling Guide โโ The MV / DV / CV / PV variable classification system
- Industrial Control Systems and the Data Insight Platform โโ How optimization results connect to APC/RTO
- S-Plot Marker Plot โโ Marker screening under OPLS models