2017-01-19 05:50:04 +01:00
package command
// This file contains all the Backend-related function calls on Meta,
// exported and private.
import (
command: Early error message for missing cache entries of locked providers
In the original incarnation of Meta.providerFactories we were returning
into a Meta.contextOpts whose signature didn't allow it to return an
error directly, and so we had compromised by making the provider factory
functions themselves return errors once called.
Subsequent work made Meta.contextOpts need to return an error anyway, but
at the time we neglected to update our handling of the providerFactories
result, having it still defer the error handling until we finally
instantiate a provider.
Although that did ultimately get the expected result anyway, the error
ended up being reported from deep in the guts of a Terraform Core graph
walk, in whichever concurrently-visited graph node happened to try to
instantiate the plugin first. This meant that the exact phrasing of the
error message would vary between runs and the reporting codepath didn't
have enough context to given an actionable suggestion on how to proceed.
In this commit we make Meta.contextOpts pass through directly any error
that Meta.providerFactories produces, and then make Meta.providerFactories
produce a special error type so that Meta.Backend can ultimately return
a user-friendly diagnostic message containing a specific suggestion to
run "terraform init", along with a short explanation of what a provider
plugin is.
The reliance here on an implied contract between two functions that are
not directly connected in the callstack is non-ideal, and so hopefully
we'll revisit this further in future work on the overall architecture of
the CLI layer. To try to make this robust in the meantime though, I wrote
it to use the errors.As function to potentially unwrap a wrapped version
of our special error type, in case one of the intervening layers is
changed at some point to wrap the downstream error before returning it.
2021-10-01 23:51:06 +02:00
"bytes"
2017-04-01 21:42:13 +02:00
"context"
2018-03-28 00:31:05 +02:00
"encoding/json"
command: Early error message for missing cache entries of locked providers
In the original incarnation of Meta.providerFactories we were returning
into a Meta.contextOpts whose signature didn't allow it to return an
error directly, and so we had compromised by making the provider factory
functions themselves return errors once called.
Subsequent work made Meta.contextOpts need to return an error anyway, but
at the time we neglected to update our handling of the providerFactories
result, having it still defer the error handling until we finally
instantiate a provider.
Although that did ultimately get the expected result anyway, the error
ended up being reported from deep in the guts of a Terraform Core graph
walk, in whichever concurrently-visited graph node happened to try to
instantiate the plugin first. This meant that the exact phrasing of the
error message would vary between runs and the reporting codepath didn't
have enough context to given an actionable suggestion on how to proceed.
In this commit we make Meta.contextOpts pass through directly any error
that Meta.providerFactories produces, and then make Meta.providerFactories
produce a special error type so that Meta.Backend can ultimately return
a user-friendly diagnostic message containing a specific suggestion to
run "terraform init", along with a short explanation of what a provider
plugin is.
The reliance here on an implied contract between two functions that are
not directly connected in the callstack is non-ideal, and so hopefully
we'll revisit this further in future work on the overall architecture of
the CLI layer. To try to make this robust in the meantime though, I wrote
it to use the errors.As function to potentially unwrap a wrapped version
of our special error type, in case one of the intervening layers is
changed at some point to wrap the downstream error before returning it.
2021-10-01 23:51:06 +02:00
"errors"
2017-01-19 05:50:04 +01:00
"fmt"
"log"
"path/filepath"
2018-10-31 16:45:03 +01:00
"strconv"
2017-01-19 05:50:04 +01:00
"strings"
2019-09-10 00:58:44 +02:00
"github.com/hashicorp/hcl/v2"
"github.com/hashicorp/hcl/v2/hcldec"
2021-05-17 17:42:17 +02:00
"github.com/hashicorp/terraform/internal/backend"
2021-10-13 17:22:12 +02:00
"github.com/hashicorp/terraform/internal/cloud"
2021-05-17 21:07:38 +02:00
"github.com/hashicorp/terraform/internal/command/arguments"
"github.com/hashicorp/terraform/internal/command/clistate"
"github.com/hashicorp/terraform/internal/command/views"
2021-05-17 21:17:09 +02:00
"github.com/hashicorp/terraform/internal/configs"
2021-05-17 21:33:17 +02:00
"github.com/hashicorp/terraform/internal/plans"
2021-05-17 21:43:35 +02:00
"github.com/hashicorp/terraform/internal/states/statemgr"
2021-05-17 21:46:19 +02:00
"github.com/hashicorp/terraform/internal/terraform"
2021-05-17 19:11:06 +02:00
"github.com/hashicorp/terraform/internal/tfdiags"
2018-10-31 16:45:03 +01:00
"github.com/zclconf/go-cty/cty"
ctyjson "github.com/zclconf/go-cty/cty/json"
2021-05-17 17:42:17 +02:00
backendInit "github.com/hashicorp/terraform/internal/backend/init"
backendLocal "github.com/hashicorp/terraform/internal/backend/local"
2020-11-18 19:41:33 +01:00
legacy "github.com/hashicorp/terraform/internal/legacy/terraform"
2017-01-19 05:50:04 +01:00
)
// BackendOpts are the options used to initialize a backend.Backend.
type BackendOpts struct {
2018-03-21 02:43:02 +01:00
// Config is a representation of the backend configuration block given in
// the root module, or nil if no such block is present.
Config * configs . Backend
2017-01-19 05:50:04 +01:00
2018-03-28 00:31:05 +02:00
// ConfigOverride is an hcl.Body that, if non-nil, will be used with
// configs.MergeBodies to override the type-specific backend configuration
// arguments in Config.
ConfigOverride hcl . Body
2017-03-17 07:27:05 +01:00
2017-01-19 05:50:04 +01:00
// Init should be set to true if initialization is allowed. If this is
// false, then any configuration that requires configuration will show
// an error asking the user to reinitialize.
Init bool
// ForceLocal will force a purely local backend, including state.
// You probably don't want to set this.
ForceLocal bool
}
2021-08-24 21:28:12 +02:00
// BackendWithRemoteTerraformVersion is a shared interface between the 'remote' and 'cloud' backends
// for simplified type checking when calling functions common to those particular backends.
type BackendWithRemoteTerraformVersion interface {
IgnoreVersionConflict ( )
VerifyWorkspaceTerraformVersion ( workspace string ) tfdiags . Diagnostics
2021-10-30 04:23:28 +02:00
IsLocalOperations ( ) bool
2021-08-24 21:28:12 +02:00
}
2017-01-19 05:50:04 +01:00
// Backend initializes and returns the backend for this CLI session.
//
// The backend is used to perform the actual Terraform operations. This
// abstraction enables easily sliding in new Terraform behavior such as
// remote state storage, remote operations, etc. while allowing the CLI
// to remain mostly identical.
//
// This will initialize a new backend for each call, which can carry some
// overhead with it. Please reuse the returned value for optimal behavior.
//
// Only one backend should be used per Meta. This function is stateful
// and is unsafe to create multiple backends used at once. This function
// can be called multiple times with each backend being "live" (usable)
// one at a time.
2018-10-09 23:53:24 +02:00
//
// A side-effect of this method is the population of m.backendState, recording
// the final resolved backend configuration after dealing with overrides from
// the "terraform init" command line, etc.
2018-03-28 00:31:05 +02:00
func ( m * Meta ) Backend ( opts * BackendOpts ) ( backend . Enhanced , tfdiags . Diagnostics ) {
var diags tfdiags . Diagnostics
2017-01-19 05:50:04 +01:00
// If no opts are set, then initialize
if opts == nil {
opts = & BackendOpts { }
}
// Initialize a backend from the config unless we're forcing a purely
// local operation.
var b backend . Backend
if ! opts . ForceLocal {
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
var backendDiags tfdiags . Diagnostics
b , backendDiags = m . backendFromConfig ( opts )
diags = diags . Append ( backendDiags )
2018-03-28 00:31:05 +02:00
2019-05-07 15:23:26 +02:00
if opts . Init && b != nil && ! diags . HasErrors ( ) {
// Its possible that the currently selected workspace doesn't exist, so
// we call selectWorkspace to ensure an existing workspace is selected.
if err := m . selectWorkspace ( b ) ; err != nil {
diags = diags . Append ( err )
}
}
2018-03-28 00:31:05 +02:00
if diags . HasErrors ( ) {
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: instantiated backend of type %T" , b )
2017-01-19 05:50:04 +01:00
}
2021-01-26 20:39:11 +01:00
// Set up the CLI opts we pass into backends that support it.
2020-06-16 18:23:15 +02:00
cliOpts , err := m . backendCLIOpts ( )
if err != nil {
command: Early error message for missing cache entries of locked providers
In the original incarnation of Meta.providerFactories we were returning
into a Meta.contextOpts whose signature didn't allow it to return an
error directly, and so we had compromised by making the provider factory
functions themselves return errors once called.
Subsequent work made Meta.contextOpts need to return an error anyway, but
at the time we neglected to update our handling of the providerFactories
result, having it still defer the error handling until we finally
instantiate a provider.
Although that did ultimately get the expected result anyway, the error
ended up being reported from deep in the guts of a Terraform Core graph
walk, in whichever concurrently-visited graph node happened to try to
instantiate the plugin first. This meant that the exact phrasing of the
error message would vary between runs and the reporting codepath didn't
have enough context to given an actionable suggestion on how to proceed.
In this commit we make Meta.contextOpts pass through directly any error
that Meta.providerFactories produces, and then make Meta.providerFactories
produce a special error type so that Meta.Backend can ultimately return
a user-friendly diagnostic message containing a specific suggestion to
run "terraform init", along with a short explanation of what a provider
plugin is.
The reliance here on an implied contract between two functions that are
not directly connected in the callstack is non-ideal, and so hopefully
we'll revisit this further in future work on the overall architecture of
the CLI layer. To try to make this robust in the meantime though, I wrote
it to use the errors.As function to potentially unwrap a wrapped version
of our special error type, in case one of the intervening layers is
changed at some point to wrap the downstream error before returning it.
2021-10-01 23:51:06 +02:00
if errs := providerPluginErrors ( nil ) ; errors . As ( err , & errs ) {
// This is a special type returned by m.providerFactories, which
// indicates one or more inconsistencies between the dependency
// lock file and the provider plugins actually available in the
// local cache directory.
2021-10-21 14:44:26 +02:00
//
// If initialization is allowed, we ignore this error, as it may
// be resolved by the later step where providers are fetched.
if ! opts . Init {
var buf bytes . Buffer
for addr , err := range errs {
fmt . Fprintf ( & buf , "\n - %s: %s" , addr , err )
}
suggestion := "To download the plugins required for this configuration, run:\n terraform init"
if m . RunningInAutomation {
// Don't mention "terraform init" specifically if we're running in an automation wrapper
suggestion = "You must install the required plugins before running Terraform operations."
}
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Required plugins are not installed" ,
fmt . Sprintf (
"The installed provider plugins are not consistent with the packages selected in the dependency lock file:%s\n\nTerraform uses external plugins to integrate with a variety of different infrastructure services. %s" ,
buf . String ( ) , suggestion ,
) ,
) )
return nil , diags
command: Early error message for missing cache entries of locked providers
In the original incarnation of Meta.providerFactories we were returning
into a Meta.contextOpts whose signature didn't allow it to return an
error directly, and so we had compromised by making the provider factory
functions themselves return errors once called.
Subsequent work made Meta.contextOpts need to return an error anyway, but
at the time we neglected to update our handling of the providerFactories
result, having it still defer the error handling until we finally
instantiate a provider.
Although that did ultimately get the expected result anyway, the error
ended up being reported from deep in the guts of a Terraform Core graph
walk, in whichever concurrently-visited graph node happened to try to
instantiate the plugin first. This meant that the exact phrasing of the
error message would vary between runs and the reporting codepath didn't
have enough context to given an actionable suggestion on how to proceed.
In this commit we make Meta.contextOpts pass through directly any error
that Meta.providerFactories produces, and then make Meta.providerFactories
produce a special error type so that Meta.Backend can ultimately return
a user-friendly diagnostic message containing a specific suggestion to
run "terraform init", along with a short explanation of what a provider
plugin is.
The reliance here on an implied contract between two functions that are
not directly connected in the callstack is non-ideal, and so hopefully
we'll revisit this further in future work on the overall architecture of
the CLI layer. To try to make this robust in the meantime though, I wrote
it to use the errors.As function to potentially unwrap a wrapped version
of our special error type, in case one of the intervening layers is
changed at some point to wrap the downstream error before returning it.
2021-10-01 23:51:06 +02:00
}
} else {
// All other errors just get generic handling.
diags = diags . Append ( err )
2021-10-21 14:44:26 +02:00
return nil , diags
command: Early error message for missing cache entries of locked providers
In the original incarnation of Meta.providerFactories we were returning
into a Meta.contextOpts whose signature didn't allow it to return an
error directly, and so we had compromised by making the provider factory
functions themselves return errors once called.
Subsequent work made Meta.contextOpts need to return an error anyway, but
at the time we neglected to update our handling of the providerFactories
result, having it still defer the error handling until we finally
instantiate a provider.
Although that did ultimately get the expected result anyway, the error
ended up being reported from deep in the guts of a Terraform Core graph
walk, in whichever concurrently-visited graph node happened to try to
instantiate the plugin first. This meant that the exact phrasing of the
error message would vary between runs and the reporting codepath didn't
have enough context to given an actionable suggestion on how to proceed.
In this commit we make Meta.contextOpts pass through directly any error
that Meta.providerFactories produces, and then make Meta.providerFactories
produce a special error type so that Meta.Backend can ultimately return
a user-friendly diagnostic message containing a specific suggestion to
run "terraform init", along with a short explanation of what a provider
plugin is.
The reliance here on an implied contract between two functions that are
not directly connected in the callstack is non-ideal, and so hopefully
we'll revisit this further in future work on the overall architecture of
the CLI layer. To try to make this robust in the meantime though, I wrote
it to use the errors.As function to potentially unwrap a wrapped version
of our special error type, in case one of the intervening layers is
changed at some point to wrap the downstream error before returning it.
2021-10-01 23:51:06 +02:00
}
2020-06-16 18:23:15 +02:00
}
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
cliOpts . Validation = true
2017-03-27 23:11:26 +02:00
2017-02-28 19:58:29 +01:00
// If the backend supports CLI initialization, do it.
if cli , ok := b . ( backend . CLI ) ; ok {
if err := cli . CLIInit ( cliOpts ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf (
2017-02-28 19:58:29 +01:00
"Error initializing backend %T: %s\n\n" +
2018-03-28 00:31:05 +02:00
"This is a bug; please report it to the backend developer" ,
b , err ,
) )
return nil , diags
2017-02-28 19:58:29 +01:00
}
}
2017-01-19 05:50:04 +01:00
// If the result of loading the backend is an enhanced backend,
// then return that as-is. This works even if b == nil (it will be !ok).
if enhanced , ok := b . ( backend . Enhanced ) ; ok {
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: backend %T supports operations" , b )
2017-01-19 05:50:04 +01:00
return enhanced , nil
}
// We either have a non-enhanced backend or no backend configured at
// all. In either case, we use local as our enhanced backend and the
// non-enhanced (if any) as the state backend.
if ! opts . ForceLocal {
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: backend %T does not support operations, so wrapping it in a local backend" , b )
2017-01-19 05:50:04 +01:00
}
// Build the local backend
2018-10-31 16:45:03 +01:00
local := backendLocal . NewWithBackend ( b )
2017-02-28 19:58:29 +01:00
if err := local . CLIInit ( cliOpts ) ; err != nil {
// Local backend isn't allowed to fail. It would be a bug.
panic ( err )
}
2018-10-09 23:53:24 +02:00
// If we got here from backendFromConfig returning nil then m.backendState
// won't be set, since that codepath considers that to be no backend at all,
// but our caller considers that to be the local backend with no config
// and so we'll synthesize a backend state so other code doesn't need to
// care about this special case.
//
// FIXME: We should refactor this so that we more directly and explicitly
// treat the local backend as the default, including in the UI shown to
// the user, since the local backend should only be used when learning or
// in exceptional cases and so it's better to help the user learn that
// by introducing it as a concept.
if m . backendState == nil {
// NOTE: This synthetic object is intentionally _not_ retained in the
// on-disk record of the backend configuration, which was already dealt
// with inside backendFromConfig, because we still need that codepath
// to be able to recognize the lack of a config as distinct from
// explicitly setting local until we do some more refactoring here.
2020-11-18 19:41:33 +01:00
m . backendState = & legacy . BackendState {
2018-10-09 23:53:24 +02:00
Type : "local" ,
ConfigRaw : json . RawMessage ( "{}" ) ,
}
}
2017-02-28 19:58:29 +01:00
return local , nil
2017-01-19 05:50:04 +01:00
}
2019-05-07 15:23:26 +02:00
// selectWorkspace gets a list of existing workspaces and then checks
// if the currently selected workspace is valid. If not, it will ask
// the user to select a workspace from the list.
func ( m * Meta ) selectWorkspace ( b backend . Backend ) error {
workspaces , err := b . Workspaces ( )
if err == backend . ErrWorkspacesNotSupported {
return nil
}
if err != nil {
return fmt . Errorf ( "Failed to get existing workspaces: %s" , err )
}
if len ( workspaces ) == 0 {
2021-11-01 18:20:15 +01:00
if c , ok := b . ( * cloud . Cloud ) ; ok && m . input {
// len is always 1 if using Name; 0 means we're using Tags and there
// aren't any matching workspaces. Which might be normal and fine, so
// let's just ask:
name , err := m . UIInput ( ) . Input ( context . Background ( ) , & terraform . InputOpts {
Id : "create-workspace" ,
Query : "\n[reset][bold][yellow]No workspaces found.[reset]" ,
Description : fmt . Sprintf ( inputCloudInitCreateWorkspace , strings . Join ( c . WorkspaceMapping . Tags , ", " ) ) ,
} )
name = strings . TrimSpace ( name )
if err != nil || name == "" {
return fmt . Errorf ( "Couldn't create initial workspace: no name provided" )
}
log . Printf ( "[TRACE] Meta.selectWorkspace: selecting the new TFC workspace requested by the user (%s)" , name )
return m . SetWorkspace ( name )
} else {
return fmt . Errorf ( strings . TrimSpace ( errBackendNoExistingWorkspaces ) )
}
2019-05-07 15:23:26 +02:00
}
// Get the currently selected workspace.
2020-06-16 18:23:15 +02:00
workspace , err := m . Workspace ( )
if err != nil {
return err
}
2019-05-07 15:23:26 +02:00
// Check if any of the existing workspaces matches the selected
// workspace and create a numbered list of existing workspaces.
var list strings . Builder
for i , w := range workspaces {
if w == workspace {
2021-09-22 06:29:02 +02:00
log . Printf ( "[TRACE] Meta.selectWorkspace: the currently selected workspace is present in the configured backend (%s)" , workspace )
2019-05-07 15:23:26 +02:00
return nil
}
fmt . Fprintf ( & list , "%d. %s\n" , i + 1 , w )
}
2021-09-22 06:29:02 +02:00
// If the backend only has a single workspace, select that as the current workspace
if len ( workspaces ) == 1 {
log . Printf ( "[TRACE] Meta.selectWorkspace: automatically selecting the single workspace provided by the backend (%s)" , workspaces [ 0 ] )
return m . SetWorkspace ( workspaces [ 0 ] )
}
2021-10-25 21:08:10 +02:00
if ! m . input {
return fmt . Errorf ( "Currently selected workspace %q does not exist" , workspace )
}
2021-09-22 06:29:02 +02:00
// Otherwise, ask the user to select a workspace from the list of existing workspaces.
2019-05-07 15:23:26 +02:00
v , err := m . UIInput ( ) . Input ( context . Background ( ) , & terraform . InputOpts {
Id : "select-workspace" ,
Query : fmt . Sprintf (
"\n[reset][bold][yellow]The currently selected workspace (%s) does not exist.[reset]" ,
workspace ) ,
Description : fmt . Sprintf (
strings . TrimSpace ( inputBackendSelectWorkspace ) , list . String ( ) ) ,
} )
if err != nil {
return fmt . Errorf ( "Failed to select workspace: %s" , err )
}
idx , err := strconv . Atoi ( v )
if err != nil || ( idx < 1 || idx > len ( workspaces ) ) {
return fmt . Errorf ( "Failed to select workspace: input not a valid number" )
}
2021-09-22 06:29:02 +02:00
workspace = workspaces [ idx - 1 ]
log . Printf ( "[TRACE] Meta.selectWorkspace: setting the current workpace according to user selection (%s)" , workspace )
return m . SetWorkspace ( workspace )
2019-05-07 15:23:26 +02:00
}
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
// BackendForPlan is similar to Backend, but uses backend settings that were
// stored in a plan.
//
// The current workspace name is also stored as part of the plan, and so this
// method will check that it matches the currently-selected workspace name
// and produce error diagnostics if not.
func ( m * Meta ) BackendForPlan ( settings plans . Backend ) ( backend . Enhanced , tfdiags . Diagnostics ) {
var diags tfdiags . Diagnostics
2018-10-31 16:45:03 +01:00
f := backendInit . Backend ( settings . Type )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
if f == nil {
diags = diags . Append ( fmt . Errorf ( strings . TrimSpace ( errBackendSavedUnknown ) , settings . Type ) )
return nil , diags
}
b := f ( )
2018-11-15 01:31:56 +01:00
log . Printf ( "[TRACE] Meta.BackendForPlan: instantiated backend of type %T" , b )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
schema := b . ConfigSchema ( )
configVal , err := settings . Config . Decode ( schema . ImpliedType ( ) )
if err != nil {
2021-08-31 23:33:26 +02:00
diags = diags . Append ( fmt . Errorf ( "saved backend configuration is invalid: %w" , err ) )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
return nil , diags
}
2019-02-26 00:37:20 +01:00
newVal , validateDiags := b . PrepareConfig ( configVal )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
diags = diags . Append ( validateDiags )
if validateDiags . HasErrors ( ) {
return nil , diags
}
2019-05-24 20:51:18 +02:00
configureDiags := b . Configure ( newVal )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
diags = diags . Append ( configureDiags )
2018-10-09 23:46:11 +02:00
// If the backend supports CLI initialization, do it.
if cli , ok := b . ( backend . CLI ) ; ok {
2020-06-16 18:23:15 +02:00
cliOpts , err := m . backendCLIOpts ( )
if err != nil {
diags = diags . Append ( err )
return nil , diags
}
2018-10-09 23:46:11 +02:00
if err := cli . CLIInit ( cliOpts ) ; err != nil {
diags = diags . Append ( fmt . Errorf (
"Error initializing backend %T: %s\n\n" +
"This is a bug; please report it to the backend developer" ,
b , err ,
) )
return nil , diags
}
}
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
// If the result of loading the backend is an enhanced backend,
// then return that as-is. This works even if b == nil (it will be !ok).
if enhanced , ok := b . ( backend . Enhanced ) ; ok {
2018-11-15 01:31:56 +01:00
log . Printf ( "[TRACE] Meta.BackendForPlan: backend %T supports operations" , b )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
return enhanced , nil
}
// Otherwise, we'll wrap our state-only remote backend in the local backend
// to cause any operations to be run locally.
2018-11-15 01:31:56 +01:00
log . Printf ( "[TRACE] Meta.Backend: backend %T does not support operations, so wrapping it in a local backend" , b )
2020-06-16 18:23:15 +02:00
cliOpts , err := m . backendCLIOpts ( )
if err != nil {
diags = diags . Append ( err )
return nil , diags
}
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
cliOpts . Validation = false // don't validate here in case config contains file(...) calls where the file doesn't exist
2018-10-31 16:45:03 +01:00
local := backendLocal . NewWithBackend ( b )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
if err := local . CLIInit ( cliOpts ) ; err != nil {
// Local backend should never fail, so this is always a bug.
panic ( err )
}
return local , diags
}
// backendCLIOpts returns a backend.CLIOpts object that should be passed to
// a backend that supports local CLI operations.
2020-06-16 18:23:15 +02:00
func ( m * Meta ) backendCLIOpts ( ) ( * backend . CLIOpts , error ) {
contextOpts , err := m . contextOpts ( )
2021-10-21 14:44:26 +02:00
if contextOpts == nil && err != nil {
2020-06-16 18:23:15 +02:00
return nil , err
}
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
return & backend . CLIOpts {
CLI : m . Ui ,
CLIColor : m . Colorize ( ) ,
2021-01-12 03:20:58 +01:00
Streams : m . Streams ,
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
StatePath : m . statePath ,
StateOutPath : m . stateOutPath ,
StateBackupPath : m . backupPath ,
2020-06-16 18:23:15 +02:00
ContextOpts : contextOpts ,
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
Input : m . Input ( ) ,
RunningInAutomation : m . RunningInAutomation ,
2021-10-21 14:44:26 +02:00
} , err
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
}
2017-01-19 05:50:04 +01:00
// Operation initializes a new backend.Operation struct.
//
// This prepares the operation. After calling this, the caller is expected
// to modify fields of the operation such as Sequence to specify what will
// be called.
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
func ( m * Meta ) Operation ( b backend . Backend ) * backend . Operation {
schema := b . ConfigSchema ( )
2020-06-16 18:23:15 +02:00
workspace , err := m . Workspace ( )
if err != nil {
// An invalid workspace error would have been raised when creating the
// backend, and the caller should have already exited. Seeing the error
// here first is a bug, so panic.
panic ( fmt . Sprintf ( "invalid workspace: %s" , err ) )
}
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
planOutBackend , err := m . backendState . ForPlan ( schema , workspace )
if err != nil {
// Always indicates an implementation error in practice, because
// errors here indicate invalid encoding of the backend configuration
// in memory, and we should always have validated that by the time
// we get here.
panic ( fmt . Sprintf ( "failed to encode backend configuration for plan: %s" , err ) )
}
2021-02-16 13:19:22 +01:00
stateLocker := clistate . NewNoopLocker ( )
if m . stateLock {
view := views . NewStateLocker ( arguments . ViewHuman , m . View )
stateLocker = clistate . NewLocker ( m . stateLockTimeout , view )
}
backend/local: Check dependency lock consistency before any operations
In historical versions of Terraform the responsibility to check this was
inside the terraform.NewContext function, along with various other
assorted concerns that made that function particularly complicated.
More recently, we reduced the responsibility of the "terraform" package
only to instantiating particular named plugins, assuming that its caller
is responsible for selecting appropriate versions of any providers that
_are_ external. However, until this commit we were just assuming that
"terraform init" had correctly selected appropriate plugins and recorded
them in the lock file, and so nothing was dealing with the problem of
ensuring that there haven't been any changes to the lock file or config
since the most recent "terraform init" which would cause us to need to
re-evaluate those decisions.
Part of the game here is to slightly extend the role of the dependency
locks object to also carry information about a subset of provider
addresses whose lock entries we're intentionally disregarding as part of
the various little edge-case features we have for overridding providers:
dev_overrides, "unmanaged providers", and the testing overrides in our
own unit tests. This is an in-memory-only annotation, never included in
the serialized plan files on disk.
I had originally intended to create a new package to encapsulate all of
this plugin-selection logic, including both the version constraint
checking here and also the handling of the provider factory functions, but
as an interim step I've just made version constraint consistency checks
the responsibility of the backend/local package, which means that we'll
always catch problems as part of preparing for local operations, while
not imposing these additional checks on commands that _don't_ run local
operations, such as "terraform apply" when in remote operations mode.
2021-09-30 02:31:43 +02:00
depLocks , diags := m . lockedDependencies ( )
if diags . HasErrors ( ) {
// We can't actually report errors from here, but m.lockedDependencies
// should always have been called earlier to prepare the "ContextOpts"
// for the backend anyway, so we should never actually get here in
// a real situation. If we do get here then the backend will inevitably
// fail downstream somwhere if it tries to use the empty depLocks.
log . Printf ( "[WARN] Failed to load dependency locks while preparing backend operation (ignored): %s" , diags . Err ( ) . Error ( ) )
}
2017-01-19 05:50:04 +01:00
return & backend . Operation {
backend/local: Check dependency lock consistency before any operations
In historical versions of Terraform the responsibility to check this was
inside the terraform.NewContext function, along with various other
assorted concerns that made that function particularly complicated.
More recently, we reduced the responsibility of the "terraform" package
only to instantiating particular named plugins, assuming that its caller
is responsible for selecting appropriate versions of any providers that
_are_ external. However, until this commit we were just assuming that
"terraform init" had correctly selected appropriate plugins and recorded
them in the lock file, and so nothing was dealing with the problem of
ensuring that there haven't been any changes to the lock file or config
since the most recent "terraform init" which would cause us to need to
re-evaluate those decisions.
Part of the game here is to slightly extend the role of the dependency
locks object to also carry information about a subset of provider
addresses whose lock entries we're intentionally disregarding as part of
the various little edge-case features we have for overridding providers:
dev_overrides, "unmanaged providers", and the testing overrides in our
own unit tests. This is an in-memory-only annotation, never included in
the serialized plan files on disk.
I had originally intended to create a new package to encapsulate all of
this plugin-selection logic, including both the version constraint
checking here and also the handling of the provider factory functions, but
as an interim step I've just made version constraint consistency checks
the responsibility of the backend/local package, which means that we'll
always catch problems as part of preparing for local operations, while
not imposing these additional checks on commands that _don't_ run local
operations, such as "terraform apply" when in remote operations mode.
2021-09-30 02:31:43 +02:00
PlanOutBackend : planOutBackend ,
Targets : m . targets ,
UIIn : m . UIInput ( ) ,
UIOut : m . Ui ,
Workspace : workspace ,
StateLocker : stateLocker ,
DependencyLocks : depLocks ,
2017-01-19 05:50:04 +01:00
}
}
// backendConfig returns the local configuration for the backend
2018-03-28 00:31:05 +02:00
func ( m * Meta ) backendConfig ( opts * BackendOpts ) ( * configs . Backend , int , tfdiags . Diagnostics ) {
var diags tfdiags . Diagnostics
2017-05-01 23:47:53 +02:00
if opts . Config == nil {
// check if the config was missing, or just not required
2019-11-14 23:33:43 +01:00
conf , moreDiags := m . loadBackendConfig ( "." )
diags = diags . Append ( moreDiags )
if moreDiags . HasErrors ( ) {
return nil , 0 , diags
2017-01-19 05:50:04 +01:00
}
2017-05-01 23:47:53 +02:00
if conf == nil {
2018-11-13 03:27:39 +01:00
log . Println ( "[TRACE] Meta.Backend: no config given or present on disk, so returning nil config" )
2018-03-28 00:31:05 +02:00
return nil , 0 , nil
2017-01-19 05:50:04 +01:00
}
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: BackendOpts.Config not set, so using settings loaded from %s" , conf . DeclRange )
2017-05-01 23:47:53 +02:00
opts . Config = conf
2017-01-19 05:50:04 +01:00
}
2017-05-01 23:47:53 +02:00
c := opts . Config
2017-01-19 05:50:04 +01:00
2018-03-28 00:31:05 +02:00
if c == nil {
2018-11-13 03:27:39 +01:00
log . Println ( "[TRACE] Meta.Backend: no explicit backend config, so returning nil config" )
2018-03-28 00:31:05 +02:00
return nil , 0 , nil
2017-03-17 07:27:05 +01:00
}
2018-10-31 16:45:03 +01:00
bf := backendInit . Backend ( c . Type )
2018-03-28 00:31:05 +02:00
if bf == nil {
diags = diags . Append ( & hcl . Diagnostic {
Severity : hcl . DiagError ,
Summary : "Invalid backend type" ,
Detail : fmt . Sprintf ( "There is no backend type named %q." , c . Type ) ,
Subject : & c . TypeRange ,
} )
return nil , 0 , diags
2017-01-19 05:50:04 +01:00
}
2018-03-28 00:31:05 +02:00
b := bf ( )
2017-01-19 05:50:04 +01:00
2018-03-28 00:31:05 +02:00
configSchema := b . ConfigSchema ( )
configBody := c . Config
configHash := c . Hash ( configSchema )
2017-01-19 05:50:04 +01:00
2018-03-28 00:31:05 +02:00
// If we have an override configuration body then we must apply it now.
if opts . ConfigOverride != nil {
2018-11-13 03:27:39 +01:00
log . Println ( "[TRACE] Meta.Backend: merging -backend-config=... CLI overrides into backend configuration" )
2018-03-28 00:31:05 +02:00
configBody = configs . MergeBodies ( configBody , opts . ConfigOverride )
2017-01-19 05:50:04 +01:00
}
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: built configuration for %q backend with hash value %d" , c . Type , configHash )
2018-03-28 00:31:05 +02:00
// We'll shallow-copy configs.Backend here so that we can replace the
// body without affecting others that hold this reference.
configCopy := * c
2018-11-09 02:08:32 +01:00
configCopy . Config = configBody
2018-03-28 00:31:05 +02:00
return & configCopy , configHash , diags
2017-01-19 05:50:04 +01:00
}
// backendFromConfig returns the initialized (not configured) backend
// directly from the config/state..
//
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
// This function handles various edge cases around backend config loading. For
// example: new config changes, backend type changes, etc.
//
// As of the 0.12 release it can no longer migrate from legacy remote state
// to backends, and will instead instruct users to use 0.11 or earlier as
// a stepping-stone to do that migration.
2017-01-19 05:50:04 +01:00
//
// This function may query the user for input unless input is disabled, in
// which case this function will error.
2018-03-28 00:31:05 +02:00
func ( m * Meta ) backendFromConfig ( opts * BackendOpts ) ( backend . Backend , tfdiags . Diagnostics ) {
2017-01-19 05:50:04 +01:00
// Get the local backend configuration.
2018-03-28 00:31:05 +02:00
c , cHash , diags := m . backendConfig ( opts )
if diags . HasErrors ( ) {
return nil , diags
2017-03-16 19:47:59 +01:00
}
2018-10-09 23:53:24 +02:00
// ------------------------------------------------------------------------
// For historical reasons, current backend configuration for a working
// directory is kept in a *state-like* file, using the legacy state
// structures in the Terraform package. It is not actually a Terraform
// state, and so only the "backend" portion of it is actually used.
//
// The remainder of this code often confusingly refers to this as a "state",
// so it's unfortunately important to remember that this is not actually
// what we _usually_ think of as "state", and is instead a local working
// directory "backend configuration state" that is never persisted anywhere.
//
// Since the "real" state has since moved on to be represented by
// states.State, we can recognize the special meaning of state that applies
// to this function and its callees by their continued use of the
// otherwise-obsolete terraform.State.
// ------------------------------------------------------------------------
2017-01-19 05:50:04 +01:00
// Get the path to where we store a local cache of backend configuration
// if we're using a remote backend. This may not yet exist which means
// we haven't used a non-local backend before. That is okay.
statePath := filepath . Join ( m . DataDir ( ) , DefaultStateFilename )
2020-08-11 17:43:01 +02:00
sMgr := & clistate . LocalState { Path : statePath }
2017-01-19 05:50:04 +01:00
if err := sMgr . RefreshState ( ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( "Failed to load state: %s" , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
// Load the state, it must be non-nil for the tests below but can be empty
s := sMgr . State ( )
if s == nil {
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: backend has not previously been initialized in this working directory" )
2020-11-18 19:41:33 +01:00
s = legacy . NewState ( )
2018-11-13 03:27:39 +01:00
} else if s . Backend != nil {
log . Printf ( "[TRACE] Meta.Backend: working directory was previously initialized for %q backend" , s . Backend . Type )
} else {
log . Printf ( "[TRACE] Meta.Backend: working directory was previously initialized but has no backend (is using legacy remote state?)" )
2017-01-19 05:50:04 +01:00
}
2017-04-20 23:26:50 +02:00
// if we want to force reconfiguration of the backend, we set the backend
// state to nil on this copy. This will direct us through the correct
// configuration path in the switch statement below.
if m . reconfigure {
s . Backend = nil
}
2017-01-19 05:50:04 +01:00
// Upon return, we want to set the state we're using in-memory so that
// we can access it for commands.
m . backendState = nil
defer func ( ) {
if s := sMgr . State ( ) ; s != nil && ! s . Backend . Empty ( ) {
m . backendState = s . Backend
}
} ( )
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
if ! s . Remote . Empty ( ) {
// Legacy remote state is no longer supported. User must first
// migrate with Terraform 0.11 or earlier.
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Legacy remote state not supported" ,
"This working directory is configured for legacy remote state, which is no longer supported from Terraform v0.12 onwards. To migrate this environment, first run \"terraform init\" under a Terraform 0.11 release, and then upgrade Terraform again." ,
) )
return nil , diags
}
// This switch statement covers all the different combinations of
// configuring new backends, updating previously-configured backends, etc.
2017-01-19 05:50:04 +01:00
switch {
// No configuration set at all. Pure local state.
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
case c == nil && s . Backend . Empty ( ) :
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: using default local state only (no backend configuration, and no existing initialized backend)" )
2017-01-19 05:50:04 +01:00
return nil , nil
// We're unsetting a backend (moving from backend => local)
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
case c == nil && ! s . Backend . Empty ( ) :
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: previously-initialized %q backend is no longer present in config" , s . Backend . Type )
2021-05-14 23:36:54 +02:00
initReason := fmt . Sprintf ( "Unsetting the previously set backend %q" , s . Backend . Type )
2017-01-19 05:50:04 +01:00
if ! opts . Init {
2021-05-14 23:36:54 +02:00
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Backend initialization required, please run \"terraform init\"" ,
fmt . Sprintf ( strings . TrimSpace ( errBackendInit ) , initReason ) ,
) )
return nil , diags
}
if ! m . migrateState {
diags = diags . Append ( migrateOrReconfigDiag )
2018-03-28 00:31:05 +02:00
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-03-28 00:31:05 +02:00
return m . backend_c_r_S ( c , cHash , sMgr , true )
2017-01-19 05:50:04 +01:00
// Configuring a backend for the first time.
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
case c != nil && s . Backend . Empty ( ) :
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: moving from default local state only to %q backend" , c . Type )
2017-01-19 05:50:04 +01:00
if ! opts . Init {
2021-10-21 21:29:12 +02:00
if c . Type == "cloud" {
2021-10-28 00:05:36 +02:00
initReason := "Initial configuration of Terraform Cloud"
2021-10-21 21:29:12 +02:00
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
2021-10-28 00:05:36 +02:00
"Terraform Cloud initialization required, please run \"terraform init\"" ,
fmt . Sprintf ( strings . TrimSpace ( errBackendInitCloud ) , initReason ) ,
2021-10-21 21:29:12 +02:00
) )
} else {
initReason := fmt . Sprintf ( "Initial configuration of the requested backend %q" , c . Type )
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Backend initialization required, please run \"terraform init\"" ,
fmt . Sprintf ( strings . TrimSpace ( errBackendInit ) , initReason ) ,
) )
}
2018-03-28 00:31:05 +02:00
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-03-28 00:31:05 +02:00
return m . backend_C_r_s ( c , cHash , sMgr )
2017-01-19 05:50:04 +01:00
// Potentially changing a backend configuration
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
case c != nil && ! s . Backend . Empty ( ) :
2021-11-02 19:26:00 +01:00
// We are not going to migrate if...
//
// We're not initializing
// AND the backend cache hash values match, indicating that the stored config is valid and completely unchanged.
// AND we're not providing any overrides. An override can mean a change overriding an unchanged backend block (indicated by the hash value).
2019-05-24 17:31:04 +02:00
if ( uint64 ( cHash ) == s . Backend . Hash ) && ( ! opts . Init || opts . ConfigOverride == nil ) {
2018-11-15 23:45:10 +01:00
log . Printf ( "[TRACE] Meta.Backend: using already-initialized, unchanged %q backend configuration" , c . Type )
2021-11-02 19:26:00 +01:00
return m . savedBackend ( sMgr )
2018-11-15 23:45:10 +01:00
}
2021-11-02 19:26:00 +01:00
// If our configuration (the result of both the literal configuration and given
// -backend-config options) is the same, then we're just initializing a previously
// configured backend. The literal configuration may differ, however, so while we
// don't need to migrate, we update the backend cache hash value.
2018-11-09 21:13:30 +01:00
if ! m . backendConfigNeedsMigration ( c , s . Backend ) {
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: using already-initialized %q backend configuration" , c . Type )
2021-11-02 19:26:00 +01:00
savedBackend , moreDiags := m . savedBackend ( sMgr )
diags = diags . Append ( moreDiags )
if moreDiags . HasErrors ( ) {
return nil , diags
}
// It's possible for a backend to be unchanged, and the config itself to
// have changed by moving a parameter from the config to `-backend-config`
// In this case, we update the Hash.
moreDiags = m . updateSavedBackendHash ( cHash , sMgr )
if moreDiags . HasErrors ( ) {
return nil , diags
}
return savedBackend , diags
2017-01-19 05:50:04 +01:00
}
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: backend configuration has changed (from type %q to type %q)" , s . Backend . Type , c . Type )
2017-01-19 05:50:04 +01:00
2021-10-21 13:19:33 +02:00
initReason := ""
switch {
case c . Type == "cloud" :
initReason = fmt . Sprintf ( "Backend configuration changed from %q to Terraform Cloud" , s . Backend . Type )
case s . Backend . Type != c . Type :
2021-05-14 23:36:54 +02:00
initReason = fmt . Sprintf ( "Backend configuration changed from %q to %q" , s . Backend . Type , c . Type )
2021-10-21 13:19:33 +02:00
default :
initReason = fmt . Sprintf ( "Backend configuration changed for %q" , c . Type )
2021-05-14 23:36:54 +02:00
}
2017-01-19 05:50:04 +01:00
if ! opts . Init {
2021-10-21 13:19:33 +02:00
if c . Type == "cloud" {
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
2021-10-28 00:05:36 +02:00
"Terraform Cloud initialization required, please run \"terraform init\"" ,
fmt . Sprintf ( strings . TrimSpace ( errBackendInitCloud ) , initReason ) ,
2021-10-21 13:19:33 +02:00
) )
} else {
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Backend initialization required, please run \"terraform init\"" ,
fmt . Sprintf ( strings . TrimSpace ( errBackendInit ) , initReason ) ,
) )
}
2021-05-14 23:36:54 +02:00
return nil , diags
}
if ! m . migrateState {
2021-10-21 22:54:41 +02:00
if c . Type == "cloud" {
diags = diags . Append ( migrateOrReconfigDiagCloud )
} else {
diags = diags . Append ( migrateOrReconfigDiag )
}
2018-03-28 00:31:05 +02:00
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-11-09 21:13:30 +01:00
log . Printf ( "[WARN] backend config has changed since last init" )
2018-03-28 00:31:05 +02:00
return m . backend_C_r_S_changed ( c , cHash , sMgr , true )
2017-01-19 05:50:04 +01:00
default :
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf (
2017-01-19 05:50:04 +01:00
"Unhandled backend configuration state. This is a bug. Please\n" +
"report this error with the following information.\n\n" +
"Config Nil: %v\n" +
terraform: Ugly huge change to weave in new State and Plan types
Due to how often the state and plan types are referenced throughout
Terraform, there isn't a great way to switch them out gradually. As a
consequence, this huge commit gets us from the old world to a _compilable_
new world, but still has a large number of known test failures due to
key functionality being stubbed out.
The stubs here are for anything that interacts with providers, since we
now need to do the follow-up work to similarly replace the old
terraform.ResourceProvider interface with its replacement in the new
"providers" package. That work, along with work to fix the remaining
failing tests, will follow in subsequent commits.
The aim here was to replace all references to terraform.State and its
downstream types with states.State, terraform.Plan with plans.Plan,
state.State with statemgr.State, and switch to the new implementations of
the state and plan file formats. However, due to the number of times those
types are used, this also ended up affecting numerous other parts of core
such as terraform.Hook, the backend.Backend interface, and most of the CLI
commands.
Just as with 5861dbf3fc49b19587a31816eb06f511ab861bb4 before, I apologize
in advance to the person who inevitably just found this huge commit while
spelunking through the commit history.
2018-08-14 23:24:45 +02:00
"Saved Backend Empty: %v\n" ,
c == nil , s . Backend . Empty ( ) ,
2018-03-28 00:31:05 +02:00
) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
}
2020-01-07 21:07:06 +01:00
// backendFromState returns the initialized (not configured) backend directly
// from the state. This should be used only when a user runs `terraform init
// -backend=false`. This function returns a local backend if there is no state
// or no backend configured.
func ( m * Meta ) backendFromState ( ) ( backend . Backend , tfdiags . Diagnostics ) {
var diags tfdiags . Diagnostics
// Get the path to where we store a local cache of backend configuration
// if we're using a remote backend. This may not yet exist which means
// we haven't used a non-local backend before. That is okay.
statePath := filepath . Join ( m . DataDir ( ) , DefaultStateFilename )
2020-08-11 17:43:01 +02:00
sMgr := & clistate . LocalState { Path : statePath }
2020-01-07 21:07:06 +01:00
if err := sMgr . RefreshState ( ) ; err != nil {
diags = diags . Append ( fmt . Errorf ( "Failed to load state: %s" , err ) )
return nil , diags
}
s := sMgr . State ( )
if s == nil {
// no state, so return a local backend
log . Printf ( "[TRACE] Meta.Backend: backend has not previously been initialized in this working directory" )
return backendLocal . New ( ) , diags
}
if s . Backend == nil {
// s.Backend is nil, so return a local backend
log . Printf ( "[TRACE] Meta.Backend: working directory was previously initialized but has no backend (is using legacy remote state?)" )
return backendLocal . New ( ) , diags
}
log . Printf ( "[TRACE] Meta.Backend: working directory was previously initialized for %q backend" , s . Backend . Type )
//backend init function
if s . Backend . Type == "" {
return backendLocal . New ( ) , diags
}
f := backendInit . Backend ( s . Backend . Type )
if f == nil {
diags = diags . Append ( fmt . Errorf ( strings . TrimSpace ( errBackendSavedUnknown ) , s . Backend . Type ) )
return nil , diags
}
b := f ( )
// The configuration saved in the working directory state file is used
// in this case, since it will contain any additional values that
// were provided via -backend-config arguments on terraform init.
schema := b . ConfigSchema ( )
configVal , err := s . Backend . Config ( schema )
if err != nil {
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Failed to decode current backend config" ,
fmt . Sprintf ( "The backend configuration created by the most recent run of \"terraform init\" could not be decoded: %s. The configuration may have been initialized by an earlier version that used an incompatible configuration structure. Run \"terraform init -reconfigure\" to force re-initialization of the backend." , err ) ,
) )
return nil , diags
}
// Validate the config and then configure the backend
newVal , validDiags := b . PrepareConfig ( configVal )
diags = diags . Append ( validDiags )
if validDiags . HasErrors ( ) {
return nil , diags
}
configDiags := b . Configure ( newVal )
diags = diags . Append ( configDiags )
if configDiags . HasErrors ( ) {
return nil , diags
}
return b , diags
}
2017-01-19 05:50:04 +01:00
//-------------------------------------------------------------------
// Backend Config Scenarios
//
// The functions below cover handling all the various scenarios that
// can exist when loading a backend. They are named in the format of
// "backend_C_R_S" where C, R, S may be upper or lowercase. Lowercase
// means it is false, uppercase means it is true. The full set of eight
// possible cases is handled.
//
// The fields are:
//
// * C - Backend configuration is set and changed in TF files
// * R - Legacy remote state is set
// * S - Backend configuration is set in the state
//
//-------------------------------------------------------------------
// Unconfiguring a backend (moving from backend => local).
2020-08-11 17:43:01 +02:00
func ( m * Meta ) backend_c_r_S ( c * configs . Backend , cHash int , sMgr * clistate . LocalState , output bool ) ( backend . Backend , tfdiags . Diagnostics ) {
2017-01-19 05:50:04 +01:00
s := sMgr . State ( )
// Get the backend type for output
backendType := s . Backend . Type
2021-10-27 23:27:12 +02:00
if s . Backend . Type == "cloud" {
m . Ui . Output ( strings . TrimSpace ( outputBackendMigrateLocalFromCloud ) )
} else {
m . Ui . Output ( fmt . Sprintf ( strings . TrimSpace ( outputBackendMigrateLocal ) , s . Backend . Type ) )
}
2017-01-19 05:50:04 +01:00
2017-12-18 17:11:09 +01:00
// Grab a purely local backend to get the local state if it exists
2021-10-25 17:28:02 +02:00
localB , diags := m . Backend ( & BackendOpts { ForceLocal : true , Init : true } )
2018-03-28 00:31:05 +02:00
if diags . HasErrors ( ) {
return nil , diags
2017-12-18 17:11:09 +01:00
}
2017-02-28 19:13:03 +01:00
2017-12-18 17:11:09 +01:00
// Initialize the configured backend
2021-11-02 19:26:00 +01:00
b , moreDiags := m . savedBackend ( sMgr )
2018-03-28 00:31:05 +02:00
diags = diags . Append ( moreDiags )
if moreDiags . HasErrors ( ) {
return nil , diags
2017-12-18 17:11:09 +01:00
}
2017-01-19 05:50:04 +01:00
2017-12-18 17:11:09 +01:00
// Perform the migration
2018-03-28 00:31:05 +02:00
err := m . backendMigrateState ( & backendMigrateOpts {
2021-10-05 22:36:50 +02:00
SourceType : s . Backend . Type ,
DestinationType : "local" ,
Source : b ,
Destination : localB ,
2017-12-18 17:11:09 +01:00
} )
if err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( err )
return nil , diags
2017-01-19 05:50:04 +01:00
}
// Remove the stored metadata
s . Backend = nil
if err := sMgr . WriteState ( s ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( strings . TrimSpace ( errBackendClearSaved ) , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
if err := sMgr . PersistState ( ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( strings . TrimSpace ( errBackendClearSaved ) , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
if output {
m . Ui . Output ( m . Colorize ( ) . Color ( fmt . Sprintf (
"[reset][green]\n\n" +
strings . TrimSpace ( successBackendUnset ) , backendType ) ) )
}
// Return no backend
2018-03-28 00:31:05 +02:00
return nil , diags
2017-01-19 05:50:04 +01:00
}
// Configuring a backend for the first time.
2020-08-11 17:43:01 +02:00
func ( m * Meta ) backend_C_r_s ( c * configs . Backend , cHash int , sMgr * clistate . LocalState ) ( backend . Backend , tfdiags . Diagnostics ) {
2017-01-19 05:50:04 +01:00
// Get the backend
2018-03-28 00:31:05 +02:00
b , configVal , diags := m . backendInitFromConfig ( c )
if diags . HasErrors ( ) {
return nil , diags
2017-01-19 05:50:04 +01:00
}
// Grab a purely local backend to get the local state if it exists
2021-10-25 17:28:02 +02:00
localB , localBDiags := m . Backend ( & BackendOpts { ForceLocal : true , Init : true } )
2018-03-28 00:31:05 +02:00
if localBDiags . HasErrors ( ) {
diags = diags . Append ( localBDiags )
return nil , diags
2017-01-19 05:50:04 +01:00
}
2017-02-28 19:13:03 +01:00
2018-10-31 16:45:03 +01:00
workspaces , err := localB . Workspaces ( )
2017-01-19 05:50:04 +01:00
if err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( errBackendLocalRead , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-10-31 16:45:03 +01:00
2020-08-11 17:43:01 +02:00
var localStates [ ] statemgr . Full
2018-10-31 16:45:03 +01:00
for _ , workspace := range workspaces {
localState , err := localB . StateMgr ( workspace )
if err != nil {
diags = diags . Append ( fmt . Errorf ( errBackendLocalRead , err ) )
return nil , diags
}
if err := localState . RefreshState ( ) ; err != nil {
diags = diags . Append ( fmt . Errorf ( errBackendLocalRead , err ) )
return nil , diags
}
// We only care about non-empty states.
if localS := localState . State ( ) ; ! localS . Empty ( ) {
2018-11-13 03:27:39 +01:00
log . Printf ( "[TRACE] Meta.Backend: will need to migrate workspace states because of existing %q workspace" , workspace )
2018-10-31 16:45:03 +01:00
localStates = append ( localStates , localState )
2018-11-13 03:27:39 +01:00
} else {
log . Printf ( "[TRACE] Meta.Backend: ignoring local %q workspace because its state is empty" , workspace )
2018-10-31 16:45:03 +01:00
}
2017-01-19 05:50:04 +01:00
}
2018-10-31 16:45:03 +01:00
if len ( localStates ) > 0 {
2017-01-19 05:50:04 +01:00
// Perform the migration
err = m . backendMigrateState ( & backendMigrateOpts {
2021-10-05 22:36:50 +02:00
SourceType : "local" ,
DestinationType : c . Type ,
Source : localB ,
Destination : b ,
2017-01-19 05:50:04 +01:00
} )
if err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( err )
return nil , diags
2017-01-19 05:50:04 +01:00
}
2017-03-31 21:21:32 +02:00
// we usually remove the local state after migration to prevent
// confusion, but adding a default local backend block to the config
// can get us here too. Don't delete our state if the old and new paths
// are the same.
erase := true
2018-10-31 16:45:03 +01:00
if newLocalB , ok := b . ( * backendLocal . Local ) ; ok {
if localB , ok := localB . ( * backendLocal . Local ) ; ok {
2018-11-16 01:01:56 +01:00
if newLocalB . PathsConflictWith ( localB ) {
2017-03-31 21:21:32 +02:00
erase = false
2018-11-16 01:01:56 +01:00
log . Printf ( "[TRACE] Meta.Backend: both old and new backends share the same local state paths, so not erasing old state" )
2017-03-31 21:21:32 +02:00
}
}
2017-01-19 05:50:04 +01:00
}
2017-03-31 21:21:32 +02:00
if erase {
2018-11-16 01:01:56 +01:00
log . Printf ( "[TRACE] Meta.Backend: removing old state snapshots from old backend" )
2018-10-31 16:45:03 +01:00
for _ , localState := range localStates {
// We always delete the local state, unless that was our new state too.
if err := localState . WriteState ( nil ) ; err != nil {
diags = diags . Append ( fmt . Errorf ( errBackendMigrateLocalDelete , err ) )
return nil , diags
}
if err := localState . PersistState ( ) ; err != nil {
diags = diags . Append ( fmt . Errorf ( errBackendMigrateLocalDelete , err ) )
return nil , diags
}
2017-03-31 21:21:32 +02:00
}
2017-01-19 05:50:04 +01:00
}
}
2017-04-01 21:42:13 +02:00
if m . stateLock {
2021-02-16 13:19:22 +01:00
view := views . NewStateLocker ( arguments . ViewHuman , m . View )
stateLocker := clistate . NewLocker ( m . stateLockTimeout , view )
2018-02-23 17:28:47 +01:00
if err := stateLocker . Lock ( sMgr , "backend from plan" ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( "Error locking state: %s" , err ) )
return nil , diags
2017-04-01 21:42:13 +02:00
}
2021-02-16 13:19:22 +01:00
defer stateLocker . Unlock ( )
2017-02-09 21:35:49 +01:00
}
2018-03-28 00:31:05 +02:00
configJSON , err := ctyjson . Marshal ( configVal , b . ConfigSchema ( ) . ImpliedType ( ) )
if err != nil {
diags = diags . Append ( fmt . Errorf ( "Can't serialize backend configuration as JSON: %s" , err ) )
return nil , diags
}
2017-01-19 05:50:04 +01:00
// Store the metadata in our saved state location
s := sMgr . State ( )
if s == nil {
2020-11-18 19:41:33 +01:00
s = legacy . NewState ( )
2017-01-19 05:50:04 +01:00
}
2020-11-18 19:41:33 +01:00
s . Backend = & legacy . BackendState {
2018-03-28 00:31:05 +02:00
Type : c . Type ,
ConfigRaw : json . RawMessage ( configJSON ) ,
2018-12-18 23:50:42 +01:00
Hash : uint64 ( cHash ) ,
2017-01-19 05:50:04 +01:00
}
2017-02-09 21:35:49 +01:00
2017-01-19 05:50:04 +01:00
if err := sMgr . WriteState ( s ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( errBackendWriteSaved , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
if err := sMgr . PersistState ( ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( errBackendWriteSaved , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
2021-10-13 17:22:12 +02:00
// By now the backend is successfully configured. If using Terraform Cloud, the success
// message is handled as part of the final init message
if _ , ok := b . ( * cloud . Cloud ) ; ! ok {
m . Ui . Output ( m . Colorize ( ) . Color ( fmt . Sprintf (
"[reset][green]\n" + strings . TrimSpace ( successBackendSet ) , s . Backend . Type ) ) )
}
2018-11-12 16:51:32 +01:00
2018-03-28 00:31:05 +02:00
return b , diags
2017-01-19 05:50:04 +01:00
}
// Changing a previously saved backend.
2020-08-11 17:43:01 +02:00
func ( m * Meta ) backend_C_r_S_changed ( c * configs . Backend , cHash int , sMgr * clistate . LocalState , output bool ) ( backend . Backend , tfdiags . Diagnostics ) {
2017-01-19 05:50:04 +01:00
if output {
// Notify the user
m . Ui . Output ( m . Colorize ( ) . Color ( fmt . Sprintf (
2021-11-03 20:41:55 +01:00
"[reset]%s\n" ,
2017-01-19 05:50:04 +01:00
strings . TrimSpace ( outputBackendReconfigure ) ) ) )
}
2017-02-09 21:35:49 +01:00
// Get the old state
s := sMgr . State ( )
2017-01-19 05:50:04 +01:00
// Get the backend
2018-03-28 00:31:05 +02:00
b , configVal , diags := m . backendInitFromConfig ( c )
if diags . HasErrors ( ) {
return nil , diags
2017-01-19 05:50:04 +01:00
}
2017-12-20 23:50:37 +01:00
// no need to confuse the user if the backend types are the same
if s . Backend . Type != c . Type {
2021-10-18 23:02:45 +02:00
output := fmt . Sprintf ( outputBackendMigrateChange , s . Backend . Type , c . Type )
if c . Type == "cloud" {
output = fmt . Sprintf ( outputBackendMigrateChangeCloud , s . Backend . Type )
}
2021-11-03 20:41:55 +01:00
m . Ui . Output ( m . Colorize ( ) . Color ( fmt . Sprintf (
"[reset]%s\n" ,
strings . TrimSpace ( output ) ) ) )
2017-12-20 23:50:37 +01:00
}
2017-01-19 05:50:04 +01:00
2017-12-18 17:11:09 +01:00
// Grab the existing backend
2021-11-02 19:26:00 +01:00
oldB , oldBDiags := m . savedBackend ( sMgr )
2018-03-28 00:31:05 +02:00
diags = diags . Append ( oldBDiags )
if oldBDiags . HasErrors ( ) {
return nil , diags
2017-12-18 17:11:09 +01:00
}
2017-01-19 05:50:04 +01:00
2017-12-18 17:11:09 +01:00
// Perform the migration
2018-03-28 00:31:05 +02:00
err := m . backendMigrateState ( & backendMigrateOpts {
2021-10-05 22:36:50 +02:00
SourceType : s . Backend . Type ,
DestinationType : c . Type ,
Source : oldB ,
Destination : b ,
2017-12-18 17:11:09 +01:00
} )
if err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( err )
return nil , diags
2017-01-19 05:50:04 +01:00
}
2017-04-01 21:42:13 +02:00
if m . stateLock {
2021-02-16 13:19:22 +01:00
view := views . NewStateLocker ( arguments . ViewHuman , m . View )
stateLocker := clistate . NewLocker ( m . stateLockTimeout , view )
2018-02-23 17:28:47 +01:00
if err := stateLocker . Lock ( sMgr , "backend from plan" ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( "Error locking state: %s" , err ) )
return nil , diags
2017-04-01 21:42:13 +02:00
}
2021-02-16 13:19:22 +01:00
defer stateLocker . Unlock ( )
2017-02-09 21:35:49 +01:00
}
2018-03-28 00:31:05 +02:00
configJSON , err := ctyjson . Marshal ( configVal , b . ConfigSchema ( ) . ImpliedType ( ) )
if err != nil {
diags = diags . Append ( fmt . Errorf ( "Can't serialize backend configuration as JSON: %s" , err ) )
return nil , diags
}
2017-01-19 05:50:04 +01:00
// Update the backend state
2017-02-09 21:35:49 +01:00
s = sMgr . State ( )
2017-01-19 05:50:04 +01:00
if s == nil {
2020-11-18 19:41:33 +01:00
s = legacy . NewState ( )
2017-01-19 05:50:04 +01:00
}
2020-11-18 19:41:33 +01:00
s . Backend = & legacy . BackendState {
2018-03-28 00:31:05 +02:00
Type : c . Type ,
ConfigRaw : json . RawMessage ( configJSON ) ,
2018-12-18 23:50:42 +01:00
Hash : uint64 ( cHash ) ,
2017-01-19 05:50:04 +01:00
}
2017-02-09 21:35:49 +01:00
2017-01-19 05:50:04 +01:00
if err := sMgr . WriteState ( s ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( errBackendWriteSaved , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
if err := sMgr . PersistState ( ) ; err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( errBackendWriteSaved , err ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
if output {
2021-10-18 23:02:45 +02:00
// By now the backend is successfully configured. If using Terraform Cloud, the success
// message is handled as part of the final init message
if _ , ok := b . ( * cloud . Cloud ) ; ! ok {
m . Ui . Output ( m . Colorize ( ) . Color ( fmt . Sprintf (
"[reset][green]\n" + strings . TrimSpace ( successBackendSet ) , s . Backend . Type ) ) )
}
2017-01-19 05:50:04 +01:00
}
2018-03-28 00:31:05 +02:00
return b , diags
2017-01-19 05:50:04 +01:00
}
2021-11-02 19:26:00 +01:00
// Initializing a saved backend from the cache file (legacy state file)
//
// TODO: This is extremely similar to Meta.backendFromState() but for legacy reasons this is the
// function used by the migration APIs within this file. The other handles 'init -backend=false',
// specifically.
func ( m * Meta ) savedBackend ( sMgr * clistate . LocalState ) ( backend . Backend , tfdiags . Diagnostics ) {
2018-03-28 00:31:05 +02:00
var diags tfdiags . Diagnostics
2017-01-19 05:50:04 +01:00
s := sMgr . State ( )
// Get the backend
2018-10-31 16:45:03 +01:00
f := backendInit . Backend ( s . Backend . Type )
2017-02-22 20:17:27 +01:00
if f == nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( strings . TrimSpace ( errBackendSavedUnknown ) , s . Backend . Type ) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
b := f ( )
2018-03-28 00:31:05 +02:00
// The configuration saved in the working directory state file is used
// in this case, since it will contain any additional values that
// were provided via -backend-config arguments on terraform init.
schema := b . ConfigSchema ( )
configVal , err := s . Backend . Config ( schema )
2017-01-19 05:50:04 +01:00
if err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( tfdiags . Sourceless (
tfdiags . Error ,
"Failed to decode current backend config" ,
fmt . Sprintf ( "The backend configuration created by the most recent run of \"terraform init\" could not be decoded: %s. The configuration may have been initialized by an earlier version that used an incompatible configuration structure. Run \"terraform init -reconfigure\" to force re-initialization of the backend." , err ) ,
) )
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-03-28 00:31:05 +02:00
// Validate the config and then configure the backend
2019-02-26 00:37:20 +01:00
newVal , validDiags := b . PrepareConfig ( configVal )
2018-03-28 00:31:05 +02:00
diags = diags . Append ( validDiags )
if validDiags . HasErrors ( ) {
return nil , diags
2017-01-19 05:50:04 +01:00
}
2019-02-26 00:37:20 +01:00
2019-05-24 20:51:18 +02:00
configDiags := b . Configure ( newVal )
2018-03-28 00:31:05 +02:00
diags = diags . Append ( configDiags )
if configDiags . HasErrors ( ) {
return nil , diags
2017-01-19 05:50:04 +01:00
}
2018-03-28 00:31:05 +02:00
return b , diags
}
2017-02-28 19:13:03 +01:00
2021-11-02 19:26:00 +01:00
func ( m * Meta ) updateSavedBackendHash ( cHash int , sMgr * clistate . LocalState ) tfdiags . Diagnostics {
var diags tfdiags . Diagnostics
s := sMgr . State ( )
if s . Backend . Hash != uint64 ( cHash ) {
s . Backend . Hash = uint64 ( cHash )
if err := sMgr . WriteState ( s ) ; err != nil {
diags = diags . Append ( err )
}
}
return diags
}
2017-01-19 05:50:04 +01:00
//-------------------------------------------------------------------
// Reusable helper functions for backend management
//-------------------------------------------------------------------
2018-11-09 21:13:30 +01:00
// backendConfigNeedsMigration returns true if migration might be required to
// move from the configured backend to the given cached backend config.
//
// This must be called with the synthetic *configs.Backend that results from
// merging in any command-line options for correct behavior.
//
// If either the given configuration or cached configuration are invalid then
// this function will conservatively assume that migration is required,
// expecting that the migration code will subsequently deal with the same
// errors.
2020-11-18 19:41:33 +01:00
func ( m * Meta ) backendConfigNeedsMigration ( c * configs . Backend , s * legacy . BackendState ) bool {
2018-11-09 21:13:30 +01:00
if s == nil || s . Empty ( ) {
log . Print ( "[TRACE] backendConfigNeedsMigration: no cached config, so migration is required" )
return true
}
if c . Type != s . Type {
log . Printf ( "[TRACE] backendConfigNeedsMigration: type changed from %q to %q, so migration is required" , s . Type , c . Type )
return true
}
// We need the backend's schema to do our comparison here.
f := backendInit . Backend ( c . Type )
if f == nil {
log . Printf ( "[TRACE] backendConfigNeedsMigration: no backend of type %q, which migration codepath must handle" , c . Type )
return true // let the migration codepath deal with the missing backend
}
b := f ( )
schema := b . ConfigSchema ( )
decSpec := schema . NoneRequired ( ) . DecoderSpec ( )
givenVal , diags := hcldec . Decode ( c . Config , decSpec , nil )
if diags . HasErrors ( ) {
log . Printf ( "[TRACE] backendConfigNeedsMigration: failed to decode given config; migration codepath must handle problem: %s" , diags . Error ( ) )
return true // let the migration codepath deal with these errors
}
cachedVal , err := s . Config ( schema )
if err != nil {
log . Printf ( "[TRACE] backendConfigNeedsMigration: failed to decode cached config; migration codepath must handle problem: %s" , err )
return true // let the migration codepath deal with the error
}
// If we get all the way down here then it's the exact equality of the
// two decoded values that decides our outcome. It's safe to use RawEquals
// here (rather than Equals) because we know that unknown values can
// never appear in backend configurations.
if cachedVal . RawEquals ( givenVal ) {
log . Print ( "[TRACE] backendConfigNeedsMigration: given configuration matches cached configuration, so no migration is required" )
return false
}
log . Print ( "[TRACE] backendConfigNeedsMigration: configuration values have changed, so migration is required" )
return true
}
2018-03-28 00:31:05 +02:00
func ( m * Meta ) backendInitFromConfig ( c * configs . Backend ) ( backend . Backend , cty . Value , tfdiags . Diagnostics ) {
var diags tfdiags . Diagnostics
2017-01-19 05:50:04 +01:00
// Get the backend
2018-10-31 16:45:03 +01:00
f := backendInit . Backend ( c . Type )
2017-02-22 20:17:27 +01:00
if f == nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( strings . TrimSpace ( errBackendNewUnknown ) , c . Type ) )
return nil , cty . NilVal , diags
2017-01-19 05:50:04 +01:00
}
b := f ( )
2018-03-28 00:31:05 +02:00
schema := b . ConfigSchema ( )
2018-11-01 19:59:07 +01:00
decSpec := schema . NoneRequired ( ) . DecoderSpec ( )
2018-03-28 00:31:05 +02:00
configVal , hclDiags := hcldec . Decode ( c . Config , decSpec , nil )
diags = diags . Append ( hclDiags )
if hclDiags . HasErrors ( ) {
return nil , cty . NilVal , diags
}
2017-01-19 05:50:04 +01:00
// TODO: test
if m . Input ( ) {
var err error
2018-03-28 00:31:05 +02:00
configVal , err = m . inputForSchema ( configVal , schema )
2017-01-19 05:50:04 +01:00
if err != nil {
2018-03-28 00:31:05 +02:00
diags = diags . Append ( fmt . Errorf ( "Error asking for input to configure backend %q: %s" , c . Type , err ) )
2017-01-19 05:50:04 +01:00
}
2019-03-02 00:45:06 +01:00
// We get an unknown here if the if the user aborted input, but we can't
// turn that into a config value, so set it to null and let the provider
// handle it in PrepareConfig.
if ! configVal . IsKnown ( ) {
configVal = cty . NullVal ( configVal . Type ( ) )
}
2017-01-19 05:50:04 +01:00
}
2019-02-26 00:37:20 +01:00
newVal , validateDiags := b . PrepareConfig ( configVal )
2021-04-02 23:11:20 +02:00
diags = diags . Append ( validateDiags . InConfigBody ( c . Config , "" ) )
2018-03-28 00:31:05 +02:00
if validateDiags . HasErrors ( ) {
return nil , cty . NilVal , diags
2017-01-19 05:50:04 +01:00
}
2019-05-24 20:51:18 +02:00
configureDiags := b . Configure ( newVal )
2021-04-02 23:11:20 +02:00
diags = diags . Append ( configureDiags . InConfigBody ( c . Config , "" ) )
2017-01-19 05:50:04 +01:00
2018-03-28 00:31:05 +02:00
return b , configVal , diags
2017-01-19 05:50:04 +01:00
}
2021-08-24 21:28:12 +02:00
// Helper method to ignore remote/cloud backend version conflicts. Only call this
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
// for commands which cannot accidentally upgrade remote state files.
2021-08-24 21:28:12 +02:00
func ( m * Meta ) ignoreRemoteVersionConflict ( b backend . Backend ) {
if back , ok := b . ( BackendWithRemoteTerraformVersion ) ; ok {
back . IgnoreVersionConflict ( )
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
}
}
// Helper method to check the local Terraform version against the configured
// version in the remote workspace, returning diagnostics if they conflict.
2021-08-24 21:28:12 +02:00
func ( m * Meta ) remoteVersionCheck ( b backend . Backend , workspace string ) tfdiags . Diagnostics {
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
var diags tfdiags . Diagnostics
2021-08-24 21:28:12 +02:00
if back , ok := b . ( BackendWithRemoteTerraformVersion ) ; ok {
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
// Allow user override based on command-line flag
if m . ignoreRemoteVersion {
2021-08-24 21:28:12 +02:00
back . IgnoreVersionConflict ( )
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
}
// If the override is set, this check will return a warning instead of
// an error
2021-08-24 21:28:12 +02:00
versionDiags := back . VerifyWorkspaceTerraformVersion ( workspace )
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
diags = diags . Append ( versionDiags )
2021-01-13 16:43:35 +01:00
// If there are no errors resulting from this check, we do not need to
// check again
if ! diags . HasErrors ( ) {
2021-08-24 21:28:12 +02:00
back . IgnoreVersionConflict ( )
2021-01-13 16:43:35 +01:00
}
backend: Validate remote backend Terraform version
When using the enhanced remote backend, a subset of all Terraform
operations are supported. Of these, only plan and apply can be executed
on the remote infrastructure (e.g. Terraform Cloud). Other operations
run locally and use the remote backend for state storage.
This causes problems when the local version of Terraform does not match
the configured version from the remote workspace. If the two versions
are incompatible, an `import` or `state mv` operation can cause the
remote workspace to be unusable until a manual fix is applied.
To prevent this from happening accidentally, this commit introduces a
check that the local Terraform version and the configured remote
workspace Terraform version are compatible. This check is skipped for
commands which do not write state, and can also be disabled by the use
of a new command-line flag, `-ignore-remote-version`.
Terraform version compatibility is defined as:
- For all releases before 0.14.0, local must exactly equal remote, as
two different versions cannot share state;
- 0.14.0 to 1.0.x are compatible, as we will not change the state
version number until at least Terraform 1.1.0;
- Versions after 1.1.0 must have the same major and minor versions, as
we will not change the state version number in a patch release.
If the two versions are incompatible, a diagnostic is displayed,
advising that the error can be suppressed with `-ignore-remote-version`.
When this flag is used, the diagnostic is still displayed, but as a
warning instead of an error.
Commands which will not write state can assert this fact by calling the
helper `meta.ignoreRemoteBackendVersionConflict`, which will disable the
checks. Those which can write state should instead call the helper
`meta.remoteBackendVersionCheck`, which will return diagnostics for
display.
In addition to these explicit paths for managing the version check, we
have an implicit check in the remote backend's state manager
initialization method. Both of the above helpers will disable this
check. This fallback is in place to ensure that future code paths which
access state cannot accidentally skip the remote version check.
2020-11-13 22:43:56 +01:00
}
return diags
}
2017-01-19 05:50:04 +01:00
//-------------------------------------------------------------------
// Output constants and initialization code
//-------------------------------------------------------------------
const errBackendLocalRead = `
Error reading local state : % s
Terraform is trying to read your local state to determine if there is
state to migrate to your newly configured backend . Terraform can ' t continue
without this check because that would risk losing state . Please resolve the
error above and try again .
`
const errBackendMigrateLocalDelete = `
Error deleting local state after migration : % s
Your local state is deleted after successfully migrating it to the newly
configured backend . As part of the deletion process , a backup is made at
the standard backup path unless explicitly asked not to . To cleanly operate
with a backend , we must delete the local state file . Please resolve the
issue above and retry the command .
`
const errBackendNewUnknown = `
The backend % q could not be found .
This is the backend specified in your Terraform configuration file .
This error could be a simple typo in your configuration , but it can also
be caused by using a Terraform version that doesn ' t support the specified
backend type . Please check your configuration and your Terraform version .
If you ' d like to run Terraform and store state locally , you can fix this
error by removing the backend configuration from your configuration .
`
2019-05-07 15:23:26 +02:00
const errBackendNoExistingWorkspaces = `
No existing workspaces .
2018-11-12 16:51:32 +01:00
Use the "terraform workspace" command to create and select a new workspace .
If the backend already contains existing workspaces , you may need to update
the backend configuration .
`
2017-01-19 05:50:04 +01:00
const errBackendSavedUnknown = `
The backend % q could not be found .
This is the backend that this Terraform environment is configured to use
both in your configuration and saved locally as your last - used backend .
If it isn ' t found , it could mean an alternate version of Terraform was
used with this configuration . Please use the proper version of Terraform that
contains support for this backend .
If you ' d like to force remove this backend , you must update your configuration
to not use the backend and run "terraform init" ( or any other command ) again .
`
const errBackendClearSaved = `
Error clearing the backend configuration : % s
Terraform removes the saved backend configuration when you ' re removing a
configured backend . This must be done so future Terraform runs know to not
use the backend configuration . Please look at the error above , resolve it ,
and try again .
`
const errBackendInit = `
2021-05-14 23:36:54 +02:00
Reason : % s
2017-01-19 05:50:04 +01:00
The "backend" is the interface that Terraform uses to store state ,
perform operations , etc . If this message is showing up , it means that the
Terraform configuration you ' re using is using a custom configuration for
the Terraform backend .
Changes to backend configurations require reinitialization . This allows
2021-05-14 23:36:54 +02:00
Terraform to set up the new configuration , copy existing state , etc . Please run
"terraform init" with either the "-reconfigure" or "-migrate-state" flags to
use the current configuration .
2017-01-19 05:50:04 +01:00
If the change reason above is incorrect , please verify your configuration
hasn ' t changed and try again . At this point , no changes to your existing
configuration or state have been made .
`
2021-10-21 13:19:33 +02:00
const errBackendInitCloud = `
2021-10-28 00:05:36 +02:00
Reason : % s
2021-10-21 13:19:33 +02:00
2021-10-28 00:05:36 +02:00
Changes to the Terraform Cloud configuration block require reinitialization .
This allows Terraform to set up the new configuration , copy existing state , etc .
2021-10-21 13:19:33 +02:00
Please run "terraform init" with either the "-reconfigure" or "-migrate-state"
2021-10-28 00:05:36 +02:00
flags to use the current configuration .
2021-10-21 13:19:33 +02:00
If the change reason above is incorrect , please verify your configuration
hasn ' t changed and try again . At this point , no changes to your existing
configuration or state have been made .
`
2017-01-19 05:50:04 +01:00
const errBackendWriteSaved = `
Error saving the backend configuration : % s
Terraform saves the complete backend configuration in a local file for
configuring the backend on future operations . This cannot be disabled . Errors
are usually due to simple file permission errors . Please look at the error
above , resolve it , and try again .
`
2017-12-18 17:11:09 +01:00
const outputBackendMigrateChange = `
2017-12-20 23:50:37 +01:00
Terraform detected that the backend type changed from % q to % q .
2017-01-19 05:50:04 +01:00
`
2021-10-18 23:02:45 +02:00
const outputBackendMigrateChangeCloud = `
Terraform detected that the backend type changed from % q to Terraform Cloud .
`
2017-12-18 17:11:09 +01:00
const outputBackendMigrateLocal = `
Terraform has detected you ' re unconfiguring your previously set % q backend .
2017-01-19 05:50:04 +01:00
`
2021-10-27 23:27:12 +02:00
const outputBackendMigrateLocalFromCloud = `
Terraform has detected you ' re unconfiguring Terraform Cloud .
`
2017-01-19 05:50:04 +01:00
const outputBackendReconfigure = `
[ reset ] [ bold ] Backend configuration changed ! [ reset ]
Terraform has detected that the configuration specified for the backend
2017-12-20 23:50:37 +01:00
has changed . Terraform will now check for existing state in the backends .
2017-01-19 05:50:04 +01:00
`
2021-11-01 18:20:15 +01:00
const inputCloudInitCreateWorkspace = `
There are no workspaces with the configured tags ( % s )
in your Terraform Cloud organization . To finish initializing , Terraform needs at
least one workspace available .
Terraform can create a properly tagged workspace for you now . Please enter a
2021-11-15 16:21:31 +01:00
name to create a new Terraform Cloud workspace .
2021-11-01 18:20:15 +01:00
`
2017-01-19 05:50:04 +01:00
const successBackendUnset = `
Successfully unset the backend % q . Terraform will now operate locally .
`
const successBackendSet = `
Successfully configured the backend % q ! Terraform will automatically
use this backend unless the backend configuration changes .
`
2021-05-14 23:36:54 +02:00
var migrateOrReconfigDiag = tfdiags . Sourceless (
tfdiags . Error ,
"Backend configuration changed" ,
"A change in the backend configuration has been detected, which may require migrating existing state.\n\n" +
"If you wish to attempt automatic migration of the state, use \"terraform init -migrate-state\".\n" +
` If you wish to store the current configuration with no changes to the state, use "terraform init -reconfigure". ` )
2021-10-21 22:54:41 +02:00
var migrateOrReconfigDiagCloud = tfdiags . Sourceless (
tfdiags . Error ,
"Terraform Cloud configuration changed" ,
"A change in the Terraform Cloud configuration has been detected, which may require migrating existing state.\n\n" +
"If you wish to attempt automatic migration of the state, use \"terraform init -migrate-state\".\n" +
` If you wish to store the current configuration with no changes to the state, use "terraform init -reconfigure". ` )