2021-05-28 03:07:09 +02:00
|
|
|
package getmodules
|
|
|
|
|
2021-11-01 21:09:16 +01:00
|
|
|
import (
|
|
|
|
"context"
|
|
|
|
)
|
|
|
|
|
2021-05-28 03:07:09 +02:00
|
|
|
// PackageFetcher is a low-level utility for fetching remote module packages
|
|
|
|
// into local filesystem directories in preparation for use by higher-level
|
|
|
|
// module installer functionality implemented elsewhere.
|
|
|
|
//
|
|
|
|
// A PackageFetcher works only with entire module packages and never with
|
|
|
|
// the individual modules within a package.
|
|
|
|
//
|
|
|
|
// A particular PackageFetcher instance remembers the target directory of
|
|
|
|
// any successfully-installed package so that it can optimize future calls
|
|
|
|
// that have the same package address by copying the local directory tree,
|
|
|
|
// rather than fetching the package from its origin repeatedly. There is
|
|
|
|
// no way to reset this cache, so a particular PackageFetcher instance should
|
|
|
|
// live only for the duration of a single initialization process.
|
|
|
|
type PackageFetcher struct {
|
|
|
|
getter reusingGetter
|
|
|
|
}
|
|
|
|
|
Refactoring of module source addresses and module installation
It's been a long while since we gave close attention to the codepaths for
module source address parsing and external module package installation.
Due to their age, these codepaths often diverged from our modern practices
such as representing address types in the addrs package, and encapsulating
package installation details only in a particular location.
In particular, this refactor makes source address parsing a separate step
from module installation, which therefore makes the result of that parsing
available to other Terraform subsystems which work with the configuration
representation objects.
This also presented the opportunity to better encapsulate our use of
go-getter into a new package "getmodules" (echoing "getproviders"), which
is intended to be the only part of Terraform that directly interacts with
go-getter.
This is largely just a refactor of the existing functionality into a new
code organization, but there is one notable change in behavior here: the
source address parsing now happens during configuration loading rather
than module installation, which may cause errors about invalid addresses
to be returned in different situations than before. That counts as
backward compatible because we only promise to remain compatible with
configurations that are _valid_, which means that they can be initialized,
planned, and applied without any errors. This doesn't introduce any new
error cases, and instead just makes a pre-existing error case be detected
earlier.
Our module registry client is still using its own special module address
type from registry/regsrc for now, with a small shim from the new
addrs.ModuleSourceRegistry type. Hopefully in a later commit we'll also
rework the registry client to work with the new address type, but this
commit is already big enough as it is.
2021-05-28 04:24:59 +02:00
|
|
|
func NewPackageFetcher() *PackageFetcher {
|
|
|
|
return &PackageFetcher{
|
|
|
|
getter: reusingGetter{},
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2021-05-28 03:07:09 +02:00
|
|
|
// FetchPackage downloads or otherwise retrieves the filesystem inside the
|
|
|
|
// package at the given address into the given local installation directory.
|
|
|
|
//
|
|
|
|
// packageAddr must be formatted as if it were the result of an
|
|
|
|
// addrs.ModulePackage.String() call. It's only defined as a raw string here
|
|
|
|
// because the getmodules package can't import the addrs package due to
|
|
|
|
// that creating a package dependency cycle.
|
|
|
|
//
|
|
|
|
// PackageFetcher only works with entire packages. If the caller is processing
|
|
|
|
// a module source address which includes a subdirectory portion then the
|
|
|
|
// caller must resolve that itself, possibly with the help of the
|
|
|
|
// getmodules.SplitPackageSubdir and getmodules.ExpandSubdirGlobs functions.
|
2021-11-01 21:09:16 +01:00
|
|
|
func (f *PackageFetcher) FetchPackage(ctx context.Context, instDir string, packageAddr string) error {
|
|
|
|
return f.getter.getWithGoGetter(ctx, instDir, packageAddr)
|
2021-05-28 03:07:09 +02:00
|
|
|
}
|