5
0
mirror of https://github.com/wailsapp/wails.git synced 2025-05-06 06:30:14 +08:00
wails/v3/internal/generator/generate.go
Fabio Massaioli 90b7ea944d
[v3] New binding generator (#3468)
* Support variadic arguments and slice, pointer types

* Fix computation of type namespaces

* Improve comments and general formatting

* Set default values correctly for composite types

* Add templates for bindings

Additionally:
* fixes generation of tuple return type
* improves imports and namespacing in JS mode
* general cleanup of generated code

* Simplify import list construction

* Refactor type generation code

Improves support for unknown types (encoded as any) and maps (using
Typescript index signatures)

* Support slices with pointer elements

* Match encoding/json behaviour in struct parser

* Update tests and example

* Add tests for complex method signatures and json tag parsing

* Add test `function_multiple_files`

* Attempt looking up idents with missing denotation

* Update test data

* fix quoted bool field

* Test quoted booleans

* Delete old parser code

* Remove old test data

* Update bindgen flags

* Makes call by ID the default

* Add package loading code

* Add static analyser

* Temporarily ignore binding generation code

* Add complex slice expressions test

* Fix variable reference analysis

* Unwrap casts to interface types

* Complete code comments

* Refactor static analyser

* Restrict options struct usage

* Update tests

* Fix method selector sink and source processing

* Improve Set API

* Add package info collector

* Rename analyser package to analyse

* Improve template functions

* Add index file templates

* Add glue code for binding generation

* Refactor collection and rendering code

* Implement binding generator

* Implement global index generation

* Improve marshaler and alias handling

* Use package path in binding calls by name

* Implement model collection and rendering

* Fix wrong exit condition in analyser

* Fix enum rendering

* Generate shortcuts for all packages.

* Implement generator tests

* Ignore non-pointer bound types

* Treat main package specially

* Compute stats

* Plug new API into generate command

* Support all named types

* Update JS runtime

* Report dual role types

* Remove go1.22 syntax

* Fix type assertion in TS bindings

* encoding/json compliance for arrays and slices

* Ignore got files in testdata

* Cleanup type rendering mechanism

* Update JS runtime

* Implement generic models

* Add missing field in renderer initialisation

* Improve generic creation code

* Add generic model test

* Add error reporting infrastructure

* Support configurable file names

* Detect file naming collisions

* Print final error report

* New shortcut file structure + collision detection

* Update test layout and data

* Autoconfiguration for analyser tests

* Live progress reporting

* Update code comments

* Fix model doc rendering

* Simplify name resolution

* Add test for out of tree types

* Fix generic creation code

* Fix potential collisions between methods and models

* Fix generic class alias rendering

* Report model discovery in debug mode

* Add interface mode for JS

* Collect interface method comments

* Add interface methods test

* Unwrap generic instantiations in method receivers

* Fix rendering of nullable types in interface mode

* Fix rendering of class aliases

* Expose promise cancel method to typescript

* Update test data

* Update binding example

* Fix rendering of aliased quoted type params

* Move to strongly typed bindings

* Implement lightweight analyser

* Update test cases

* Update binding example

* Add complex instantiation test

* Load full dependency tree

* Rewrite collector

* Update renderer to match new collector

* Update generator to match new collector

* Update test data

* Update binding example

* Configure includes and injections by language

* Improve system path resolution

* Support rich conditions in inject/include directives

* Fix error handling in Generator.Generate

* Retrieve compiled go file paths from fileset

* Do not rely on struct info in struct flattening algorithm

* Fix doc comment for findDeclaraion

* Fix bugs in embedded field handling

* Fix bugs and comments in package collection

* Remove useless fields from ServiceInfo

* Fix empty line at the beginning of TS indexes

* Remove global index and shortcuts

* Remove generation tests for individual packages

* Enforce lower-case file names

* Update test data

* Improve error reporting

* Update binding example

* Reintroduce go1.22 syntax

* Improve relative import path computation

* Improve alias support

* Add alias test

* Update test data

* Remove no services error

* Rename global analyser test

* Add workaround and test for bug in typeutil.Map

* Update test data

* Do not split fully qualified names

* Update typeutil package and remove workaround

* Unify alias/named type handling

* Fix rendering of generic named class aliases

* Fix rendering of array types

* Minor tweaks and cleanups

* Rmove namespaced export construct

* Update test data

* Update binding example

* Break type cycles

* Fix typo in comment

* Fix creation code for cyclic types

* Fix type of variadic params in interface mode

* Update test data

* Fix bad whitespace

* Refactor type assertions inside bound methods

* Update test data

* Rename field application.Options.Bind to Services

* Rename parser package to generator

* Update binding example

* Update test data

* Update generator readme

* Add typescript test harness

* Move test output to new subfolder

* Fix code generation bugs

* Use .js extensions in TS mode imports

* Update test data

* Revert default generator output dir to frontend/bindings

* Bump runtime package version

* Update templates

* Update changelog

* Improve newline handling

---------

Co-authored-by: Andreas Bichinger <andreas.bichinger@gmail.com>
2024-05-19 20:40:44 +10:00

294 lines
8.6 KiB
Go

package generator
import (
"fmt"
"go/types"
"io"
"os"
"slices"
"strings"
"sync"
"time"
"github.com/wailsapp/wails/v3/internal/flags"
"github.com/wailsapp/wails/v3/internal/generator/collect"
"github.com/wailsapp/wails/v3/internal/generator/config"
"github.com/wailsapp/wails/v3/internal/generator/render"
)
// Generator wraps all bookkeeping data structures that are needed
// to generate bindings for a set of packages.
type Generator struct {
options *flags.GenerateBindingsOptions
creator config.FileCreator
// serviceFiles maps service file paths to their type object.
// It is used for lower/upper-case collision detection.
// Keys are strings, values are *types.TypeName.
serviceFiles sync.Map
collector *collect.Collector
renderer *render.Renderer
logger *ErrorReport
scheduler scheduler
}
// NewGenerator configures a new generator instance.
// The options argument must not be nil.
// If creator is nil, no output file will be created.
// If logger is not nil, it is used to report messages interactively.
func NewGenerator(options *flags.GenerateBindingsOptions, creator config.FileCreator, logger config.Logger) *Generator {
if creator == nil {
creator = config.NullCreator
}
report := NewErrorReport(logger)
return &Generator{
options: options,
creator: config.FileCreatorFunc(func(path string) (io.WriteCloser, error) {
report.Debugf("writing output file %s", path)
return creator.Create(path)
}),
logger: report,
}
}
// Generate runs the binding generation process
// for the packages specified by the given patterns.
//
// Concurrent or repeated calls to Generate with the same receiver
// are not allowed.
//
// The stats result field is never nil.
//
// The error result field is nil in case of complete success (no warning).
// Otherwise, it may either report errors that occured while loading
// the initial set of packages, or errors returned by the static analyser,
// or be an [ErrorReport] instance.
//
// If error is an ErrorReport, it may have accumulated no errors, just warnings.
// When this is the case, all bindings have been generated successfully.
//
// Parsing/type-checking errors or errors encountered while writing
// individual files will be printed directly to the [config.Logger] instance
// provided during initialisation.
func (generator *Generator) Generate(patterns ...string) (stats *collect.Stats, err error) {
stats = &collect.Stats{}
stats.Start()
defer stats.Stop()
// Enable type aliases.
// This should become unnecessary from Go 1.23 onwards.
goDebug := os.Getenv("GODEBUG")
defer os.Setenv("GODEBUG", goDebug)
settings := slices.DeleteFunc(strings.Split(goDebug, ","), func(setting string) bool {
return strings.HasPrefix(setting, "gotypesalias=")
})
settings = append(settings, "gotypesalias=1")
os.Setenv("GODEBUG", strings.Join(settings, ","))
// Validate file names.
err = generator.validateFileNames()
if err != nil {
return
}
// Parse build flags.
buildFlags, err := generator.options.BuildFlags()
if err != nil {
return
}
// Start package loading feedback.
var lpkgMutex sync.Mutex
generator.logger.Statusf("Loading packages...")
go func() {
time.Sleep(5 * time.Second)
if lpkgMutex.TryLock() {
generator.logger.Statusf("Loading packages... (this may take a long time)")
lpkgMutex.Unlock()
}
}()
systemPaths, err := ResolveSystemPaths(buildFlags)
if err != nil {
return
}
// Load initial packages.
pkgs, err := LoadPackages(buildFlags, patterns...)
// Suppress package loading feedback.
lpkgMutex.Lock()
// Check for loading errors.
if err != nil {
return
}
if len(patterns) > 0 && len(pkgs) == 0 {
err = ErrNoPackages
return
}
// Report parsing/type-checking errors.
for _, pkg := range pkgs {
for _, err := range pkg.Errors {
generator.logger.Warningf("%v", err)
}
}
// Panic on repeated calls.
if generator.collector != nil {
panic("Generate() must not be called more than once on the same receiver")
}
// Initialise subcomponents.
generator.collector = collect.NewCollector(pkgs, systemPaths, generator.options, &generator.scheduler, generator.logger)
generator.renderer = render.NewRenderer(generator.options, generator.collector)
// Update status.
generator.logger.Statusf("Looking for services...")
serviceFound := sync.OnceFunc(func() { generator.logger.Statusf("Generating service bindings...") })
// Run static analysis and schedule service code generation for each result.
err = FindServices(pkgs, systemPaths, generator.logger, func(obj *types.TypeName) bool {
serviceFound()
generator.scheduler.Schedule(func() {
generator.generateService(obj)
})
return true
})
// Discard unneeded data.
pkgs = nil
// Wait until all services have been generated and all models collected.
generator.scheduler.Wait()
// Check for analyser errors.
if err != nil {
return
}
// Invariants:
// - Service files have been generated for all discovered services;
// - ModelInfo.Collect has been called on all discovered models, and therefore
// - all required models have been discovered.
// Update status.
if generator.options.NoIndex {
generator.logger.Statusf("Generating models...")
} else {
generator.logger.Statusf("Generating models and index files...")
}
// Schedule models, index and included files generation for each package.
generator.collector.Iterate(func(info *collect.PackageInfo) bool {
generator.scheduler.Schedule(func() {
generator.generateModelsIndexIncludes(info)
})
return true
})
// Wait until all models and indices have been generated.
generator.scheduler.Wait()
// Populate stats.
generator.logger.Statusf("Collecting stats...")
generator.collector.Iterate(func(info *collect.PackageInfo) bool {
stats.Add(info.Stats())
return true
})
// Return non-empty error report.
if generator.logger.HasErrors() || generator.logger.HasWarnings() {
err = generator.logger
}
return
}
// generateModelsIndexIncludes schedules generation of public/private model files,
// included files and, if allowed by the options,
// of an index file for the given package.
func (generator *Generator) generateModelsIndexIncludes(info *collect.PackageInfo) {
index := info.Index(generator.options.TS)
// info.Index implies info.Collect: goroutines spawned below
// can access package information freely.
if len(index.Models) > 0 {
generator.scheduler.Schedule(func() {
generator.generateModels(info, index.Models, false)
})
}
if len(index.Internal) > 0 {
generator.scheduler.Schedule(func() {
generator.generateModels(info, index.Internal, true)
})
}
if len(index.Package.Includes) > 0 {
generator.scheduler.Schedule(func() {
generator.generateIncludes(index)
})
}
if !generator.options.NoIndex && !index.IsEmpty() {
generator.generateIndex(index)
}
}
// validateFileNames validates user-provided filenames.
func (generator *Generator) validateFileNames() error {
switch {
case generator.options.ModelsFilename == "":
return fmt.Errorf("models filename must not be empty")
case generator.options.InternalFilename == "":
return fmt.Errorf("internal models filename must not be empty")
case !generator.options.NoIndex && generator.options.IndexFilename == "":
return fmt.Errorf("package index filename must not be empty")
case generator.options.ModelsFilename != strings.ToLower(generator.options.ModelsFilename):
return fmt.Errorf("models filename must not contain uppercase characters")
case generator.options.InternalFilename != strings.ToLower(generator.options.InternalFilename):
return fmt.Errorf("internal models filename must not contain uppercase characters")
case generator.options.IndexFilename != strings.ToLower(generator.options.IndexFilename):
return fmt.Errorf("package index filename must not contain uppercase characters")
case generator.options.ModelsFilename == generator.options.InternalFilename:
return fmt.Errorf("models and internal models cannot share the same filename")
case !generator.options.NoIndex && generator.options.ModelsFilename == generator.options.IndexFilename:
return fmt.Errorf("models and package indexes cannot share the same filename")
case !generator.options.NoIndex && generator.options.InternalFilename == generator.options.IndexFilename:
return fmt.Errorf("internal models and package indexes cannot share the same filename")
}
return nil
}
// scheduler provides an implementation of the [collect.Scheduler] interface.
type scheduler struct {
sync.WaitGroup
}
// Schedule runs the given function concurrently,
// registering it on the scheduler's wait group.
func (sched *scheduler) Schedule(task func()) {
sched.Add(1)
go func() {
defer sched.Done()
task()
}()
}