SELAB RESEARCH

Trustworthy AI-Assisted Software Engineering

We study whether the evidence software engineering relies on — tests, gates, and benchmarks — still holds when the code is written by AI.

The repository-grounded agents and tools we build are the instruments for that study, not the goal in themselves.

Current Program

The Trustworthy AI Program

2026-2028

Four questions run in sequence: whether our measurements are valid, what risk survives them, what an attacker can leave behind, and what a pipeline can actually stop. A fifth asks whether any of it still holds as models change. These are open questions under active study, not settled results.

  1. Measure

    MEASUREMENT VALIDITY · IN PROGRESS

    Evaluation Protocol Validity

    Whether an evaluation protocol measures agent capability at all, and whether protocol choice alone can reverse a published conclusion. Examined through repeated runs and protocol transfer.

    • Multi-Run Evaluation
    • Protocol Transfer
    • Reproduction
  2. Quantify

    RESIDUAL RISK

    Residual Failures Behind Green Tests

    How much behavioral failure remains in AI-generated patches that pass every test, and under what conditions an acceptance test can count as reliability evidence.

    • Behavioral Divergence
    • Lower-Bound Estimation
    • Reliability Evidence
  3. Probe

    AI SOFTWARE SECURITY · IN PROGRESS

    Persistent Unsafe Artifacts

    Whether repository-level prompt injection ends at attack success or leaves durable unsafe artifacts in the codebase, and whether those artifacts pass an ordinary development pipeline.

    • Repository Injection
    • Artifact Persistence
    • Pipeline Escape
  4. Gate

    SOFTWARE ASSURANCE

    Complementarity of Assurance Gates

    Whether tests, static analysis, and CI checks detect different defects or the same ones, and which combinations justify their cost inside an assurance pipeline.

    • Conditional Detection
    • Gate Complementarity
    • Cost–Benefit
  5. Revisit

    TEMPORAL VALIDITY

    Longitudinal Reproduction

    Whether a conclusion obtained today survives a change of model generation, and how model drift bounds the useful lifetime of an empirical finding.

    • Model Drift
    • Replication
    • Temporal Validity

Systems We Build

Agent Design Questions

4 QUESTIONS

These questions concern the systems we build to run the studies above: how an agent grounds itself in a repository, acts through tools, verifies its own output, and when coordination earns its complexity.

  1. RQ1

    REPOSITORY GROUNDING

    How can agents find sufficient and relevant evidence across a software repository?

    We connect code structure, history, issues, logs, traces, and tests while measuring when retrieved context is missing, noisy, or unsupported.

  2. RQ2

    TOOL-BASED ACTION

    How can agents turn goals into safe, observable development actions?

    We study task decomposition, bounded tool use, memory, and recovery across analyzers, build systems, tests, and version control.

  3. RQ3

    VERIFICATION & RELIABILITY

    How should agent outputs be tested, calibrated, audited, and rejected?

    We evaluate executable correctness, regressions, uncertainty, traceability, and failure detection instead of accepting fluent outputs as evidence.

  4. RQ4

    COORDINATION & HUMAN CONTROL

    When do multi-agent roles or human checkpoints outperform a single-agent workflow?

    We compare task success, cost, latency, and failure propagation so coordination is selected only when its measurable benefit justifies its complexity.

Durable Agenda

Four Long-Term Research Axes

The axes organize reusable scientific questions; individual systems and papers contribute evidence within them rather than becoming disconnected topics.

01

GROUNDING

Agentic Repository Intelligence

Grounding decisions in repository-scale evidence through structural retrieval, issue–code linking, execution traces, and context sufficiency analysis.

  • Repository Retrieval
  • Context Selection
  • Bug Localization
02

ACTION

Tool-Using Software Agents

Planning and executing software-engineering work through developer tools while preserving permissions, constraints, and an observable action trace.

  • Planning
  • Tool Execution
  • Memory & Recovery
03

VERIFICATION

Reliable Software Change

Generating tests, repairs, security findings, and documentation, then validating them against behavior, regressions, and human intent.

  • Test Generation
  • Program Repair
  • Regression Control
04

GOVERNANCE

Evaluation, Coordination & Human Oversight

Measuring robustness, calibration, traceability, cost, and latency while comparing single-agent, multi-agent, and human-in-the-loop designs.

  • Agent Evaluation
  • Multi-Agent Coordination
  • Human Checkpoints

Current Work

Current Research Programs

AGENTIC SE
  1. 01Ground
  2. 02Plan
  3. 03Act
  4. 04Verify
  5. 05Learn
Experimental Infrastructure Core Program

CodeOrchestra

Composable Agentic Workflows for Software Maintenance

An experimental architecture for composing planning, retrieval, execution, memory, and verification across repository-scale tasks. Single-agent or multi-agent coordination is selected only when role separation or independent checking is an explicit, testable design choice.

  • Workflow Composition
  • Shared Context
  • Human Checkpoints
Agentic Core Core Program

CodeAgents

Repository-Grounded Software Agents

Studies how software agents decompose goals, retrieve repository evidence, operate development tools, preserve task context, and verify outcomes through measurable decision and execution traces.

  • Planning
  • Repository Retrieval
  • Tool Use
  • Verification
Evaluation & Reliability

EvalGuard

Calibrated Decisions for Agentic Software Engineering

Examines how model scores and classifier outputs become decisions, diagnosing score compression, threshold mismatch, metric divergence, and transfer failures across software artifacts and tasks.

  • Score Auditing
  • Threshold Diagnostics
  • Calibration
Repository Intelligence

AgentReport

Evidence-Grounded Bug Reporting

Studies structured bug-report generation from symptoms, logs, traces, reproduction steps, and environment evidence so downstream localization and repair begin with auditable problem statements.

  • Symptom Analysis
  • Trace Linking
  • Reproduction Evidence
Repository Intelligence

AgentLocalization

Repository-Aware Bug Localization

Connects natural-language symptoms, execution traces, stack traces, history, and code structure to rank suspicious files, methods, and statements with inspectable supporting evidence.

  • Structural Retrieval
  • Suspiciousness Ranking
  • Evidence Linking
Reliable Change

Review2Test

Review-Grounded Test Generation

Transforms reviewer comments and pull-request discussions into explicit test objectives and executable regression tests, using execution results as feedback for validation and repair.

  • Review Understanding
  • Test Planning
  • Execution Feedback
Reliable Change

Review2Repair

Review-Guided Program Repair

Turns review intent into constrained repair plans and candidate patches, then tests whether changes address the feedback without introducing unsupported or over-broad modifications.

  • Intent Modeling
  • Patch Planning
  • Change Validation
Reliable Change

AgentRepair

Verified Repository-Aware Program Repair

Studies localization, context retrieval, patch generation, ranking, and test-guided validation with safeguards against plausible but behaviorally incorrect fixes.

  • Fault Context
  • Patch Generation
  • Regression Validation
Traceability

CommitChrono

Evidence-Linked Change Documentation

Links diffs, issues, project conventions, and development history to explain what changed, why it changed, and which evidence supports the resulting documentation.

  • Diff Analysis
  • Issue Linking
  • Convention Checking
Software Security

SecuFlow

Evidence-Aware Vulnerability Analysis

Studies how analyzers and language models combine code evidence, risk rationale, and validation steps to reduce unsupported security findings and connect them to tests or repairs.

  • Static Evidence
  • Risk Assessment
  • Security Validation

Reliability by Design

Evidence & Evaluation

Every claim is tied to an explicit task, baseline, observable trace, and failure condition.

  • Task & Success First

    Define the task, dataset, constraints, and success condition before choosing an agent architecture.

  • Comparable Baselines

    Compare non-agentic, single-agent, and multi-agent designs under the same tools, budget, and evidence.

  • Executable Evidence

    Validate claims with tests, traces, regressions, calibration, and explicit rejection when evidence is insufficient.

  • Traceable Failure

    Report ablations, costs, latency, failed cases, recovery behavior, and the points where human review is required.

Research Evolution

Research Trajectory

Our current Agentic AI agenda builds on earlier work in software analytics, deep learning, repository mining, and program repair.

  1. Trustworthy AI-Assisted Software Engineering

    Ongoing study of measurement validity, residual failure after passing tests, persistent unsafe artifacts from coding agents, complementarity of assurance gates, and whether empirical conclusions survive model generations.

    • Measurement Validity
    • Residual Risk
    • AI Software Security
    • Software Assurance
    • Longitudinal Reproduction
  2. Agentic AI for Software Engineering

    Repository-grounded agents, tool-using workflows, executable verification, reliability evaluation, and evidence-aware coordination for software maintenance.

    • Agentic Repository Intelligence
    • Tool-Using Agents
    • Reliable Software Change
    • Agent Evaluation
    • Multi-Agent Coordination
    • Human Oversight
  3. Repository-Aware LLM Systems

    Retrieval-augmented reasoning, structure-aware repository context, security-bug analysis, feature selection, and duplicate detection.

    • RAG for Code
    • AST Retrieval
    • Security Bug Analysis
    • Feature Selection
    • Duplicate Detection
    • Small LLM Workflows
  4. Applied AI & Software Mining

    Program repair, bug severity and triage, clinical NLP, voice-phishing detection, and emotion-aware applications.

    • CodeBERT APR
    • Clinical NLP
    • Bug Triage
    • Voice Phishing Detection
    • Emotion AI
  5. Deep Learning for Software Engineering

    Deep learning for bug triage, duplicate detection, bug localization, and program repair.

    • CNN-LSTM Triage
    • BERT Duplicate Detection
    • SeqGAN Repair
    • Bug Localization
  6. Software Analytics Foundations

    Bug-report mining, developer recommendation, severity prediction, topic modeling, and social-network analysis.

    • Topic Modeling
    • Social Network Analysis
    • GAN-based Repair
    • Software Analytics